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THE VALIDITY OF THE PORTEUS MAZE TEST 


MOSHE BRILL 
The Hebrew University, Jerusalem, Palestine 


Investigators who were previously engaged in the study of intelli- 
ce, have turned their attention in the past several years to the 
dy of personality and adjustment. It has been recognized by these 
estigators that no one concept, however important, suffices to inter- 
et all clinical cases. Even such fundamental concepts as general 
elligence and mental level are by no means sufficient for the diagno- 
of all types of maladjustment. There are many individuals who 
nction on an average mental level, or who, in a manner of speaking, 
e even bright, but still fail to meet the ordinary requirements placed 
bon them by the social group. A diagnostic classification, namely, 
ental age, mental level, or intelligence quotient, does not in itself 
terpret or solve a person’s failure to adjust. Lowrey' reports that 
ild guidance clinics have found mental deficiency to be a lesser factor 

the production of difficult behavior than was anticipated by 
ychiatrists. 

Although social behavior cannot be sharply divided into two distinct 
pes, namely, good and bad, individuals can be ranked from best to 
rst insofar as their social adjustment is concerned. The classroom 
cher can thus rank his pupils and point out those who do not, for 
e reason, get along socially. He may also observe that certain 
pils, though maladjusted at the moment, respond to training and 
ome better adjusted with maturity. There are also those children 
o do not respond to training and remain quite hopeless insofar as 
ial adjustment is concerned. Some of these, and other children, are 
ught to the guidance clinic. Upon studying them, the clinician 
is himself in need of some working concepts other than general 
elligence and mental level by means of which he could better inter- 
the dynamic behavior of the maladjusted individual who functions 
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on a normal, or above normal, mental level. Psychopathy is one of 
the concepts introduced to satisfy this need. 

A survey of the psychological and psychiatric literature on the mal- 
adjusted reveals many definitions of the term psychopathy and its 
synonyms. A careful examination of these definitions indicates that 
the plausible ones, at least from the clinical viewpoint, are those which 
describe the behavior of the psychopath and at the same time suggest 
that the abnormality is due to some cause or causes other than mental 
level, The term unstable is common in current professional literature. 
This is probably due to the fact that of all other terms used the word 
unstable actually describes the overt behavior of the individual usually 
classified as a psychopath. His behavior is unstable and, therefore, 
unpredictable. Unevenness of functioning, or sudden change in modes 
of reacting to similar situations, characterize certain psychopaths best. 
The significant characteristics and, hence, diagnostic difference between 
most psychopaths and non-psychopaths is the failure of the former to 
make a satisfactory social adjustment. He is reported by clinicians to 
lack, among others, the following: the habit of forethought; the ability 
to foresee and to weigh the possible consequences for self and others 
resulting from certain acts; planfulness; prudence; ability to profit by 
experience; capacity for inhibition; power of adaptation to novel 
situations. 


THE PORTEUS MAZE TEST 


Berry and Porteus? state: ‘‘ We have already indicated our approval 
of Pearson’s dictum, that it is the detection of the potential social 
inefficient which is the chief concern of mental diagnosis. Society is no 
less injured by the mentally unstable, than by the intellectually feeble- 
minded.” The early diagnosis of the incipient socially maladjusted 
individuals is thus a primary concern, if not the most important 
one, of the clinician. To make this diagnosis objective, objective 
techniques are necessary. It is evident, however, that intellectual 
retardation is not the salient feature of the psychology of a great many 
of the socially maladjusted. Tests such as the Binet have, therefore, 
only a limited value in the study of these individuals. According to 
Berry and Porteus, ‘‘What is evidently required to supplement the 
Binet examination, are tests of other capacities important for social 
sufficiency. These social capacities are in the main dependent on the 
ability to control impulsive action. In a word, we wish to test self- 
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control.”’ The Porteus Maze test was devised to measure these 
capacities. 

According to Porteus, his Maze test not only measures intelligence, 
but also other abilities and personality traits that he found to cor- 
relate highly with social adjustment. His studies on the reliability 
and validity of the Maze test are reported in his Studies in Mental 
Deviations;* The Maze Test and Mental Differences;' and others. The 
following summarizes Porteus’ claims for his Maze test: ‘‘The Porteus 
tests represent an attempt to evaluate socially valuable characteristics 
not fully tested by the Binet. These capacities are mainly prudence, 
forethought, planning capacity, ability to improve with practice, and 
adaptability to a new situation. The deficiencies in these respects, 
even more than in intellectual attainments, distinguish high-grade 
defectives from normal children; hence the value of the tests for 
diagnostic purposes. They fulfill the requirements of supplementary 
tests because they can be standardized and arranged in the form of a 
scale. They can be easily applied, and they test highly correlated 
mental functions in simple situations, so that results may be readily 
interpreted.’” 

A critical study of the original Porteus investigations reveals the 
fact that his earlier conclusions as to the validity of the test from the 
standpoint of social adaptation were not fully justified. Porteus’ 
earlier evidences were not conclusive by any means. Garrett and 
Schneck’ state: “‘From the fact that the Mazes correlate somewhat 
higher than Binet with industrial capacity and social capacity, and from 
an examination of many individual records, Porteus concludes that his 
Mazes measure aspects of character and temperament not tested by 
the Binet. While this may be true, the evidence for it is exceedingly 
meager. To be sure, Burt considers the Porteus Mazes to be useful 
supplements in estimating social as distinguished from educational 
efficiency. But just how he knows that social efficiency is the trait 
measured by the Maze is not made clear.” 

In a study by Cornell and Lowden,’ they concluded in part: ‘‘ While 
the groups show some differences of considerable interest, the differ- 
ences in individual performance are scarcely clearcut or consistent 
enough to be of more than the slightest value in diagnosis.””’ ‘‘The 
qualitative side of the test is more significant than the quantitative in 
showing temperamental factors.” ‘‘A qualitative report of the Stan- 
ford examinations shows more factors significant in diagnosis than the 
Porteus.”’ 
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THE PROBLEM* 


The present study consists of a comparison of the performance of 
fifty well-adjusted and fifty seriously maladjusted mentally deficient 
boys on the Porteus Maze test. The purpose of the study is to deter- 
mine the validity of this test. The three specific questions to be 
answered in this study are: (1) Does the Porteus Maze test age differ- 
entiate reliably between the socially adjusted and the socially malad- 
justed mentally deficient boy? (2) does the difference between the Binet 
and Porteus test ages differentiate reliably between the adjusted and 
the maladjusted mentally deficient? and (3) does scatter, or the amount 
of variability, on the Maze test differentiate reliably between the 
adjusted and maladjusted mentally deficient? 

The present study is one of a series of studies on the validity of 
various commonly used tests and scales for differentiating the socially 
maladjusted mentally deficient.° 


METHOD AND PROCEDURE 


Equating the Two Groups.—The two groups compared were well 
equated in the following items: 


(1) Nationality and race. Each group consisted of forty-nine native 
white and one colored. 

(2) All subjects in both groups were male. 

(3) Chronological age.t The means of the adjusted and maladjusted 
groups were 235.38 + 4.21 and 235.68 + 5.06 respectively; the ranges one 
hundred fifty-nine to three hundred fifty-two and one hundred fifty-seven to 
three hundred ninety-five respectively; and the sigmas 44.18 and 53.05 
respectively. The difference of the means was .30 + 6.585 and the critical 
ratio .046. 

(4) Binet test age.t The mean test ages of the adjusted and maladjusted 
groups were 107.94 + 1.93 and 107.50 + 2.19 respectively; the ranges seventy- 
eight to one hundred eighty-two and seventy-two to one hundred eighty- 
seven respectively; and the sigmas 20.22 and 22.92 respectively. The difference 
of the means was .44 + 2.915 and the critical ratio .151. 

(5) Number of months in the Colony prior to the investigation. The 
means of the adjusted and maladjusted groups were 44.00 + 3.17 and 
43.96 + 3.48 respectively; the ranges nine to one hundred eighty-two and 
eight to one hundred ninety respectively; and the sigmas 33.26 and 36.48 
respectively. The difference of the means was 0.4 + 4.709 and the critical 
ratio .009. 


* This study was made at the State Colony, New Lisbon, N. J. 
t In months. 
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(6) General physical health as rated by the resident physician. Of the 
boys in each group, fifty-two per cent were rated average, six per cent below 
average,and forty-two per cent above average. 


Comparing the Two Groups in Adjustment.—The outstanding differ- 
ence between the two groups was in the matter of social adjustment. 
To study this difference the Vineland Adjustment Score Card'® was 
used. In astudy by Oosthuizen," he concluded that “‘the claim that 
the method is workable and efficient in objectively measuring conduct 
is fully justified.” The mean Adjustment Score Card scores of the 
adjusted and maladjusted groups were 107.04 + 1.60 and 59.30 + 1.99 
respectively; the ranges seventy-three to one hundred thirty-eight 
and twenty-seven to ninety-six respectively; and the sigmas 16.75 and 
20.85 respectively. The difference of the means was 47.74 + 2.553 and 
the critical ratio 18.70. This critical ratio is more than necessary to 
prove conclusively the reliable difference between the two groups in 
adjustment as measured by the Vineland Score Card. 

To check further on the reliability of the difference between the 
two groups in continuous social adjustment, the Elm (detention) 
cottage records of the boys for the past two and a half years were 
studied. The institution where the study was made, the New Jersey 
State Colony for Feeble-Minded Males, New Lisbon, N. J., maintains 
the Elm cottage for the boys who fail to adjust in the ordinary institu- 
tional environment. This cottage is different from the open cottage 
only in that the boys in it are kept under constant supervision. The 
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Adjusted | Maladjusted 
1. Total number of days in colony for past two one- 
ESE SIREN TEES ET My eer 40,177 38 , 942 
2. Total number of days in Elm for past two one- 
EE vasschcccinncdlee etas ches tecavces 471 11,502 
3. E.D. index (ratio of two over one)............. .012 . 295 
4. Total number of commitments to Elm.......... 49 299 
5. Mean number of commitments per individual. . . .98 5.98 
6. Per cent of boys never committed to Elm....... 56 0 
7. Total number of recommitments to Elm........ 36 249 
8. Mean number of recommitments to Elm........ .52 4.98 
9. Per cent returned from jails and State Hospitals. 0 14.03 
10. Per cent committed to Elm for minor offenses. . . . 10.20 3.01 
11. Ratio between adjusted and maladjusted in three. 1 24.58 
12. Ratio between adjusted and maladjusted in five. . 1 6.10 
13. Ratio between adjusted and maladjusted in eight. 1 9.58 
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facts in the table concerning the adjustment of the boys in the two 
groups were brought out from a study of the Elm cottage data (E.D.). 

To summarize, an analysis of the Elm, or detention cottage, data 
has shown clearly the significant difference between the two groups in 
continuous social adjustment for the past two and a half years. 

The Test.—The Porteus Maze Test, Vineland 1933 Revision,'? was 
used in the present study. ‘The administering and scoring of the test 
was in strict accordance with Porteus’ instructions. Of the tests for 
adults, only Adult I was used. 


RESULTS 


A study of Table I reveals the difference between the two distribu- 
tions of the Porteus test ages, as well as the overlapping between them. 
It is sufficient to indicate, for instance, that forty per cent of the 
adjusted boys and only twenty-six per cent of the maladjusted boys 
scored below eight years. 


TaBLeE I.—DistrRisvTion oF Portsevs Trest AGES OF THE Boys IN THE Two 

















Groups 
Test ages 
Group Total 
4/\/51|6 7}8)}91/10;) 11 |}12/)13/14)15 
Es hocchavases ces 0;4;5;11};6);2);2/] 5};2/;3;6;4)] 50 
Maladjusted........... 2;3/;3)} 51/2);5);4] 91/5)}6/2/4] 50 
MSCEuS Sasi tw eccee 2'7;8)]16}8)|7/6]14;7;)9)] 8) 8] 100 












































The Difference between the Porteus Test Ages of the Two Groups.— 
Forty per cent of the adjusted boys passed the Adult I test on one of 
the four trials allowed, as did thirty-eight per cent of the maladjusted 
boys. The difference between the groups in the Adult I test is 
negligible. 

A study of Table II indicates that the mean of the maladjusted is 
larger than that of the adjusted by 6.36 + 5.07. The critical ratio 
being 1.25, it follows that the chances are approximately eighty in 
one hundred that the maladjusted will always score higher on the 
Porteus test than the adjusted. However, there is a far greater 
tendency for the two groups to overlap than to differ. Thirty-four 
per cent of the adjusted boys scored above the median for the mal- 
adjusted group (one hundred thirty-two), and thirty per cent of the 
maladjusted boys scored below the median for the adjusted group 
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(one hundred two). There is a marked difference between the mean 


and medians of both groups. Holzinger’s measure of skewness formula, 


aa 13 
Sk = 3(M 3 ne was applied. For the distribution of the adjusted 





group the skewness is +1.11; the skewness for the distribution of the 
maladjusted is —.77. This tendency to skewness explains in part 
the differences between the means and medians of the two groups. 


Tas ie II.—Portrevs Mazz Test AGEs or tHe Two Groups 

















Adjusted Maladjusted 

DD iddi ct cdanviec betadobeavieda th 60-180* 54-186 
EN PR eo Ne OATS gk eC a 116.16 + 3.65f 122.52 + 3.52 
UE Le Res SEE Nags Tey EET SS 38.30 36 . 86 
ING oe cba Sah cele eb dws ccldeb’ cde ciet a3 6.36 + 5.07 
CE aaicacd o6 chi de tub bbs ceWR ee beens ob Was ckh cen 1.25 

* In months. 

t PE. 


To summarize, the difference between the central tendencies of the 
two groups in Porteus test ages was found to be statistically unreliable. 
The Porteus Maze test age does not differentiate reliably between the 
adjusted and the maladjusted mentally deficient boy. 

The Difference between the Binet and Porteus Test Ages.—As it is the 
general practice of psychological clinics to use the Binet scale together 
with other psychometrics, it was deemed worthwhile to study here the 
tendencies of the two groups to deviate on the Porteus test from their 
respective Binet test levels. 


Tas.Le II].—Megan Binet anp Portevus Test AGzs or THE Two Groups 














Adjusted Maladjusted 
ES oe ccc ideaab sateen heehee 107.94 + 1.93 107.50 + 2.19 
I 65k Jkvcc' chbohadeebucdive 116.16 + 3.65 122.52 + 3.52 
«cic cond ianedndsbeeren 9.22 + 4.13 15.02 + 4.15 
EER RS Emme eer ae 2.23 3.55 





It appears from Table III that both groups scored higher on 
the Porteus test than on the Binet Scale. There are approximately 
ninety-three chances in one hundred that the adjusted group will 
always score higher on the Porteus than on the Binet, while the chances 
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are ninety-nine in one hundred that the same will hold true for the 
maladjusted group. This difference between the two groups is, of 
course, of no practical value to the clinician. Just how much of a 
difference in years and months, or in terms of any other units, must 
there be between an individual’s Binet and Porteus ratings to cause 
him to be classified as either adjusted or maladjusted? 

An analysis of the data in Table IV indicates that although there 
appear to be some differences between the two groups in their tenden- 
cies to deviate on the Porteus test from their Binet test levels, these 
differences are small, and are of little or no consequence. Seventy per 
cent of the maladjusted and only fifty-two per cent of the adjusted 
scored higher on the Porteus test than on the Binet scale. In the case 
of only one maladjusted subject were the Binet and Porteus test ages 
alike. The term deviation stands here for the difference between the 
Porteus and Binet test ages. Plus-deviation stands for the difference 
between the two test ages where the Porteus TA is higher than that of 
the Binet. Minus-deviation stands for the difference between the 
two test ages where the Porteus TA is lower than that of the Binet. 
Comparing the two groups in their deviations, it is found that the 
median plus-deviations of the adjusted and the maladjusted groups are 
two years seven months and two years four months respectively. 
The median minus-deviations of the adjusted and maladjusted groups 
are one year four months and one year eight months respectively. In 
other words, the maladjusted scored higher on the Binet than on the 
Porteus more often than did the adjusted. Yet, the difference between 
the two groups in the amount of deviation between the two tests is 
insignificant, and, hence, of no value clinically. For instance, an 
individual who scores two and a half years higher on the Porteus than 
on the Binet, could not be classified, because of this difference between 
his two test ages, as either adjusted or maladjusted, as stable or unsta- 
ble. There is no evidence in this study to support Porteus’ contention, 
namely, that ‘failure in the tests is more significant than success.’ 
To summarize, the difference between the Porteus and Binet test ages 
is an index of no value to the clinician in the diagnosis of maladjustment. 

Correlations.—Porteus reported the correlation of the Porteus Maze 
test with the Binet to be positive at each age level, ranging for boys, 
from .24 + .08 to .61 + .066, and for girls from .41 + .064 to 
.75 + .034.% The average r obtained approximates .51; .47 for boys 
and .56 for girls. The Pearson product moment coefficient of correla- 
tion between the Binet and the Porteus test ages of all one hundred 
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TaBLE 1V.—DIsTRIBUTION OF THE DEVIATIONS BETWEEN THE BINET AND PORTEUS ney} 
Test AGEs IN YEARS AND MONTHS OF THE ADJUSTED AND MALADJUSTED 
Porteus TA minus Binet TA| Adjusted | Maladjusted pte 2 
+7:6 0 1 1 by 
+7:0 0 0 0 , 
+6:6 0 0 0 
+6:0 1 1 2 
+5:6 3 3 6 
+5:0 2 3 5 f: 
+4:6 0 1 1 
+4:0 3 1 4 Bra 
+3:6 1 3 4 bit 
+3:0 3 2 5 
+2:6 3 4 7 4 
+2:0 3 2 5 
+1:6 3 5 8 ee 
+1:0 2 5 7 ie 
+ :6 2 4 6 es 
0 0 1 1 t 
— :6 5 2 7 thf 
—1:0 2 2 4 i 
—1:6 7 2 9 " 
—2:0 3 3 6 
—2:6 4 1 5 
—3:0 1 0 1 
—3:6 1 2 3 
—4:0 0 0 0 
—4:6 1 1 2 . 
—5:0 0 1 1 ‘" 
| ERNE oy 50 50 100 hy 
Per cent Porteus TA higher | 
than Binet TA........... 52 70 61 
Per cent Porteus TA lower 
than Binet TA........... 48 28 38 ' 
Range of deviation between , 
Porteus and Binet TA....| —4:6 to +6:0 | —5:0 to +7:6 | —5:0 to +7:6 | 
Median Porteus TA higher i 
than Binet TA........... 2:7 2:4 2:4 ; 
Q Porteus TA higher than 
PG cscnedersvess 1:3 1:9 1:4 
Median Porteus TA lower 
than Binet TA........... 1:4 1:8 1:4 
Q Porteus TA lower than 
ES vows ales ease 710 1:2 :10 
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subjects in the present study was found to be .52 + .049; the coeffi- 
cients of correlation for the adjusted and maladjusted groups separately, 
were found to be .60 + .061 and .46 + .075 respectively. Here again, 
it is apparent that the difference between the adjusted and the malad- 
justed groups in their performance on the Porteus Maze test is not of 
sufficient magnitude to be of any practical value in clinical diagnosis, 

Scatter in the Porteus Test.—With regard to scatter in the Maze test, 
Porteus states: ‘‘ As a general conclusion, it may be stated that scatter- 
ing in the Porteus test is characteristic of certain psychopathic and 
delinquent children somewhat over-rated by the test. . . . Scattering 
is not characteristic of all the psychopathic or delinquent as it fre- 
quently happens that children of these types have already scored very 
low in the Maze test in comparison with other tests.”’'® 


TaBLE V.—NvuMBER OF YEARS OF SCATTER IN THE Portevs Maze TEst OF THE 
Two Groups 














Number of years 
Groups Total 
1/2); 314);5|6/7/;8)] 9 | 10 
es kines oe pacice iam 0;4; 91';6);3);5;1/)0] 7] 15] 50 
Maladjusted................. 3/2] 6/;21/3);2/12;0;] 9/21] 50 
DLC Oe sc behhacnoeeekwes 3/6/15}; 8/6/}7|3)0) 16 | 36 | 100 






































In Table V the distribution of number of years of scatter in the 
Porteus test by the two groups is given. From this table it appears 
that the difference between the two groups in the amount of scatter 
in the Porteus test is statistically unreliable. The amount of overlap- 
ping of the two distributions is significant. Thirty per cent of the 
Adjusted boys had a scatter on the Porteus test above the median for 


TaBLe VI.—NvuMBER OF YEARS OF SCATTER IN THE PortEvs Maze TrEstT BY THE 
Two Groups 
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the Maladjusted group (nine), and thirty-two per cent of the Malad- 
justed boys had a scatter above the median for the Adjusted group 
(six). 

It appears from Table VI that the differences between the mean 
number of years of scatter in the Porteus test of the two groups is 
statistically unreliable. The critical ratio being .62, it follows that the 
chances are sixty-six in one hundred that the Maladjusted will always 
have a large scatter in the Porteus test than the adjusted. Scatter in 
the Porteus does not reliably differentiate the adjusted from the mal- 
adjusted, and is, hence, no index of diagnostic value as regards 
adjustment. 


SUMMARY AND CONCLUSIONS 


A comparative study was made of the performance of fifty socially 
well-adjusted and fifty seriously maladjusted mentally deficient boys 
on the Porteus Maze test. The purpose of the study was to determine 
the validity of this test. The three specific points to be covered in 
this study were: (1) Does the Porteus Maze test differentiate the 
adjusted from the maladjusted? (2) is the difference between the Por- 
teus and Binet test scores of diagnostic value as regards adjustment? 
and (3) does the scatter on the Maze test differentiate reliably between 
the adjusted and maladjusted mentally deficient boy? 

The two experimental groups, both living in a state institution, 
were well equated in race and nationality, sex, chronological age, Binet 
test age, number of months in the institution prior to the study, and in 
general physical health as rated by the resident physician. The only 
outstanding difference between the two groups was in the matter of 
continuous social adjustment for at least the past two and a half years. 
The adjustment of the two groups was studied by means of the Vineland 
Adjustment Score Card, and also by an analysis of the Elm detention 
cottage records of the subjects in the two groups. The following 
conclusions may be drawn from this study: 

1. The maladjusted group scored higher on the Porteus Maze test 
than the adjusted group. Although the difference of the means of the 
two groups is statistically unreliable, it is safe, nevertheless, to question 
the earlier claims advanced by Porteus that the Maze test does differ- 
entiate the socially maladjusted, and that the socially maladjusted 
score lower than the adjusted on this test. The Porteus test age arrived 
at by the method of administering and scoring described in the 1933 
Revision, does not reliably differentiate the adjusted from the mal- 
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adjusted. The adjusted actually scored higher on the Maze test than 
did the maladjusted. 

2. There are more chances for the maladjusted than for the adjusted 
to score higher on the Porteus test than on the Binet scale. Yet, the 
difference between the Binet and Porteus test ages was found not to 
differentiate between the adjusted and the maladjusted groups. The 
difference between the two tests is, therefore, no index of diagnostic 
value as regards adjustment. There is no evidence in this study to 
support Porteus’ contention, namely, that “failure in the tests is more 
significant than success.”’ 

3. The amount of scatter on the Porteus Maze test does not differ- 
entiate reliably between the adjusted and the maladjusted, and is, 
hence, of no clinical value in the diagnosis of maladjustment. 

4. Both the Adjusted and the Maladjusted scored higher on the 
Porteus test than on the Binet scale. The tendency for the Malad- 
justed to score higher on the Porteus test than on the Binet scale is 
stronger than that for the Adjusted. The coefficient of correlation 
between the Binet and Porteus test ages of the Adjusted was found to 
be higher than that of the Maladjusted. These two findings indicate 
that the relationship between the Binet and Porteus test ages is more 
definite in the case of the Adjusted than in the case of the Maladjusted. 
However, this difference between the two groups is too vague to be of 
any practical value. 

The preceding conclusions should not be misinterpreted to the effect 
that the test has no clinical values whatsoever. On the contrary, the 
clinician might use this test very profitably as a means for a qualitative 
study of the individual’s reactions under standardized procedure. It 


is desirable that additional investigations of these clinical values should 
be carried out. 
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REPEATED TESTS WITH THE CAVD SCALE 
RUDOLF PINTNER AND MILDRED STANTON 


Teachers College, Columbia University 


The curve for the general growth of intelligence from birth to 
maturity is usually assumed to be a parabolic curve. Intelligence 
increases rapidly during infancy and early childhood and then grad- 
ually slows down during adolescence and ceases during early maturity. 
Some psychologists, however, have argued for a straight line curve 
during the elementary-school period, basing their arguments upon the 
equal annual increments of gain in score on group tests of intelligence. 
But scores on almost all group intelligence tests have not been equated 
for difficulty, so that it is impossible to interpret the significance 
of gains in score from one year to the next. The Thorndike CAVD 
test is the only intelligence test so far constructed which has attempted 
to make each unit on the scale equal in difficulty to every other unit. 
A gain of one unit on this test may, therefore, be considered as a 
definite gain in altitude of intelligence, regardless of the level of 
difficulty where this gain takes place. The results of some annual 
tests with this test will be presented. | 


THE POPULATION TESTED 


The CAVD Test was given annually to a number of children. 
Table I shows the grade location of these cases at the time of the 
last test and the number of annual tests given. Practically all the 


TaBLeE I.—NvoumsBer or Cases TESTED 














Number of Grade at the time of last test 
times Total 
tested I | IT | II} IV} V | VI} Viti VII); IX | X | XI} XII 
2 oe. Oi BT BT si Ss 9 3 he i 32 
3 i. 3 1 1/131;10/] 2 7 ‘ 2 39 
4 Cy 1 1; 0j;14] 7 6 3 32 
5 : 6] 21 27 
6 10 10 
Total..... 3; 3] 2/111]16) 291171] 53 ’ ae 5 140 
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tests were given eleven, twelve or thirteen months apart. A total 


of one hundred forty children were tested with varying numbers 
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carried from two to six years. Most of the testing took place while 
the children were in grades I to VIII. The children attended public 
schools in New York City in good residential neighborhoods and would 
on the average test slightly above IQ one hundred. 


ANNUAL GAINS OR LOSSES ON ALL RE-TESTS 


We have a total of three hundred sixty-four gains or losses from 
one year to the next, taking into account every difference from one 
test to the next annual test. These three hundred sixty-four gains 
or losses are distributed as follows: 


Gans or Losses N 
Plus 3.5to3.9 1 
3.0 to 3.4 4 
2.5 to 2.9 i) 
2.0 to 2.4 19 
1.5to 1.9 46 
1.0 to 1.4 101 
.5to .9 118 
0 to .4 54 
Minus .lto .5 8 
.6 to 1.0 3 
1.1t0 1.5 0 
1.6 to 2.0 1 
CL idb ad ak a% 6 deae ees 364 
Average gain.............. 1.06 
Deb awh cise cht tansse ees 71 


Extreme range —1.8 to +3.5 
Middle 50 per cent +0.5 to +1.4 
Middle 80 per cent +0.2 to +1.9 


The average annual gain is 1.06 points. Only twelve or 3.4 per 
cent show losses. One of these losses is very large, namely 1.8 points. 
Fourteen of the gains are very large, being 2.5 points or more. The 
great majority of the gains, however, range from one-half to one and 
one-half points. This total distribution of gains contains children 
who have been tested only twice as well as children who have been 
tested up to six times. Repeated annual testing may produce practice 
effects and lead to larger gains. It would be well, therefore, to study 
the gains according to the number of tests taken. 

Table II show these mean annual gains. The first row shows that 
ten children were tested each year over a period of six years and that 
the average gain from the first to the second year (test 2 minus test 
1) was 1.26 points; the next annual gain (test 3 minus test 2) was 
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TasLe II].—Averace ANNUAL GAINS PER NuMBER OF Times TESTED 











Number Tests taken 

of N mies 
tests 2-1 3-2 4-3 5-4 6—5 
6 10 1.26 1.03 0.48 0.97 1.06 

5 27 1.36 1.07 0.79 0.75 

4 32 0.91 1.02 0.92 

3 39 0.99 1.00 

2 32 1.24 























1.03 points; and so on. A study of all these annual gains shows no 
indication of increasing gains from year to year such as might be 
expected if the tests were very susceptible to the effects of practice. 
The CAVD test is evidently similar to other intelligence tests in this 
respect. The interval of a year between tests is sufficiently long 
so that no obvious practice effects remain. The results in Table II 
also indicate that there is no constant tendency for the gains to 
increase or decrease from year to year. With remarkable consistency, 
the gains fluctuate around one point. This table tells us nothing 
about the annual gain from one chronological age to the next, because 
the children included in each group vary in chronological age. 


GAIN AND CHRONOLOGICAL AGE 


If now we take all our gains and losses and distribute them accord- 
ing to the chronological age of the child when such gains were made, 
we alrive at the average gains shown in Table III. The mean gain 


Taste III].—SHowine AVERAGE Gains FoR Eacu YEAR’s GrowTsH IN CA 














CA 7 to 8 | 8 to 9 | 9 to 10/10 to 11)11 to 12/12 to 13)13 to 14 
Mean gain.......... 1.23 | 1.28 | 1.00 | 0.87 | 0.82 | 0.84 | 0.60 
Median gain......... 0.9 1.1 i 0.8 0.9 0.8 0.7 
Bisak Kctee eusax ete 11 74 84 74 56 30 10 




















seems to indicate a rather consistent tendency to decrease as the 
child grows older. The median gain also indicates the same thing. 
This tendency is, however, not very marked and the decrease, if 
any, is very slight. Furthermore, these gains are not based upon the 
same children at each age. As the numbers are not too great at all 
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ages, the influence on the means of any particularly bright or stupid 
children in any one category may conceivably distort the general 
trend of the means. 

If, therefore, we study the gains for each chronological age for 
such groups as took the same number of tests, we shall keep our group 
constant from year to year. This cuts down the number of usable 
cases materially. These mean gains are shown in Table IV. The 


TaBLE I1V.—Mean Gains Per CA or Cases Havine Same Noumper or Re-Tests 











Number Number CA 

of of 

tests cases 8 to 9 9 to 10 10 to 11 11 to 12 
5 26 1.45 0.97 0.84 0.86 
4 43 1.38 1.07 0.84 

4 13 APs 0.74 1.02 0.75 
3 50 1.32 1.09 

3 18 Fania 0.89 0.99 




















first row of this table shows that twenty-six children were tested 
five times, and all of them were given the first test when eight years 
old. The second row shows that forty-three children were given four 
tests, beginning with the first test at year eight. And so on for the 
other rows of the table. Three rows in this table, having the largest 
sampling of cases, show a consistent tendency to a slight decrease 
in score with chronological age. The other two rows show no such 
tendency, but the number of cases in both instances is small. In 
general the table seems to point to a probable slight annual decrease 
in gain at least from ages eight to eleven. 


GAINS OF BRIGHT AND DULL CHILDREN 


We may raise the question as to whether those scoring high or 
low on the first test make similar gains. For this purpose we shall 
take the largest group of cases tested annually beginning at the same 
chronological age. This is the group of fifty-nine children tested 
first at age eight and then given two subsequent annual tests. We 
can divide this group into three groups, high, medium, low, of twenty, 
twenty and nineteen according to their first score. These three 
groups and their two average annual gains are as follows: 
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Scores on Average 
Group first test gains 
PIRES, oS F4UN Oe bas COU ea gh de douche ce’ 34.2 to 36.0 0.77 1.35 
IN iacickiinth 6 aac Rals dabble indewicbiice 32.8 to 34.1 0.89 1.09 
Bhi ie sine ene in tne ea blab Pode ceded ee 30.4 to 32.7 2.23 0.82 











This shows that the high group, having scores on the first test 
from 32.2 to 36.0, made a gain of 0.77 during the first year, and a 
gain of 1.35 during the second year. Similarly for the other two 
groups. If this small sample is at all representative, it would seem 
to indicate that dull children lose very definitely from year to year, 
whereas bright children tend to increase their gains slightly. 

The correlations between tests for these fifty-nine cases are as 
follows: 


Test 1 with Test 2, r = .680 + .047 
Test 1 with Test 3, r = .756 + .038 
Test 2 with Test 3, r = .824 + .028 


Although the correlations are fairly high, it can be seen that there 
must be many individual fluctuations from year to year in test score. 

If we take the twenty-six cases of eight-year-olds tested five times 
and divide them into two groups of thirteen according to their scores 
on the first test and then calculate the average annual gains, we have 
the following results: 














Group Scores Average annual gains 
SS ts ks bom ein O44 4% 6 400m 32.8 to 35.4} 0.65 1.08 0.96 0.87 
Gia Wikis wee ead e's wd ir 30.4 to 32.7; 2.18 0.87 0.72 0.92 











Here the brighter cases increase their gain during the second year, 
but this increase does not continue during the next two years. The 
gains for the duller cases fall sharply during the second year, and 
somewhat less so thereafter. The difference between the dull and the 
bright is very marked during the first and second years but much less 
so thereafter. 


INDIVIDUAL CASES 


The greatest number of annual tests given was six. We have 
ten children who were given six tests, thus giving five annual gains. 
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These ten cases are shown in Table V. These ten cases show the 
extreme individual differences that we encounter in the mental 
growth of children in general. Only two cases show losses, but there 
is no regularity in the individual gains from one year to the next. 
Large gains one year may be followed by small gains during the 
next year and vice versa. No case shows a consistent trend toward 
decrease or increase in gain from one year to the next. Child C 
shows the largest average annual gain, namely 1.36. Child J shows 
the smallest, namely .72. C’s advantage over J is largely due to 
one large gain made during the first year. 


SUMMARY 


One hundred forty children were tested every year on the CAVD 
Test. The number of annual tests given each child varied from two 
to six. 


TaBLeE V.—INDIVIDUAL GAINS DURING Five YEARS 























Children 
Years 
A B C D E F G H I J 
1 1.5 | 1.6 2.9 1.6 2.9 1.6 0 4 .8 |-—0.7 
2 3.0 4 1.0 0 - | .6 1.6 FASS 1.3 
3 —1.8 4 5 1.1 .6 Jn £7 5 1.7 
4 711.4 8 a BB. 2ts 1343 811.3 5 
5 1.0; 1.3 1.6 1.1 .8 .8 1.32 oes .8 
Average. . 88] 1.02 | 1.36 90 | 1.06 94 . 86 . 86) 1.00 .72 


























The average of all annual gains is 1.06 points on the CAVD Scale. 
The great majority of gains ranges from one-half to one and one-half 
points. This average gain of about one point is about one fortieth 
of the total range of the CAVD Scale. It is about one twentieth of 
that part of the scale which stretches from what imbeciles can accom- 
plish to what the upper quarter of college graduates accomplish. 
It is equivalent, as Thorndike says, to about one and one-half years 
of mental age in the age range from six to twelve. 

There seems to be a slight decrease in the average gain from year 
to year. This is shown to extend from age eight to fourteen in Table 
III, and also in Table IV for most cases from age eight to twelve. 
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The difference in the trend of the average annual gains between 
those who made initial high scores and those who made low scores has 
been studied. Those who scored low made relatively large gains 
during the first year followed by a marked drop in gains thereafter. 
Those who scored high made their largest gain during the second 
year. It is doubtful whether this represents a general tendency for 
those who score high and those who score low in this test. 

The correlation between tests for fifty-nine cases given three tests 
ranges from .68 to .82. 

Individual gains from year to year fluctuate widely and few 
individuals, if any, show a regular decrease in gain from one year to 
the next. 

Our results in general seem to point to a slight average decrease 
in gain and thus to fit in with the theory of a parabolic rather than 
a straight line curve as representing the general growth of intelligence. 














THE BASIS FOR THE PERSONAL CONSTANT 


KATHERINE PRESTON BRADWAY AND E. LOUISE HOFFEDITZ 


Department of Research, The Training School at Vineland, N. J. 


In 1924 Hugo Heinis first proposed the personal constant (PC) 
as a substitute for the intelligence quotient (IQ). The concept of the 
PC has attracted so much attention in America that a translation of 
the French article which contains the basis for the development of the 
PC would be valuable to students of mental measurement.* We have 
translated the original thirty-one pages and have selected from these 
the part which seems most pertinent to an understanding of the personal 
constant. 

Before presenting this translation it is desirable to go one step 
further back. In 1922 G. Vermeylen"™ developed a scale for measuring 
intelligence based on an adaptation of tests already in use. That scale 
consisted of fifteen ‘‘tests,’’ each of which was composed of ten items of 
one type graduated in order of increasing difficulty. With this scale 
Vermeylen examined sixty school children ranging in age from six to 
twelve years. It was the results of these examinations which Heinis 
treated statistically for the development of the formula for the personal 
constant. Consequently, a full appreciation of Heinis’ study requires 
some knowledge of the Vermeylen Scale. We are presenting in sum- 
mary a translation of Vermeylen’s description of his scale before offering 
a translation of Heinis’ article. 


VERMEYLEN SCALE 


1. Pointing.—S (subject) is shown, one at a time, ten cards which 
have been marked off into squares, certain of which contain black 
dots. On the removal of the card, S indicates the position of the dots 
on similar blank squares. The cards range in difficulty from number 
one, which contains nine squares, one of which has one dot, to number 
ten which contains sixteen squares, seven of which have one dot each. 

2. Piercing.—S is shown, one at a time, five wooden boards each 
of which contains one hundred holes variously marked. He is told to 
pierce with a stylus certain types of holes. The ten degrees of the 
series range from piercing all the holes of a board to piercing every 
third hole of a certain type in a board containing five types of holes. 


* A subsequent article was published in English by Heinis, but this article 
does not include the basic considerations which the French article does. See 5. 
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3. Repetition (Immediate Memory).—S is shown a series of ten 
cards on which are drawn objects or animals with corresponding names 
beneath, the number increasing from one to ten. S reads them over 
three times with E (examiner) pointing tothem. Sis then requested to 
repeat the names from memory. 

4. Memory.—S is presented successively with ten familiar objects 
until he can name them from memory. Forty-eight hours later he is 
asked to repeat the series. 

5. Identification.—S is shown, one at a time, ten test cards on 
which are represented abstract designs, the number increasing from one 
toten. After a test card is exposed for one second, S is shown one of a 
series of ten master cards, each containing the design or designs of the 
correspondingly numbered test card together with other designs. The 
total number of designs on master cards ranges from four to twenty- 
four. Sis to designate on the master card the designs which appeared 
on the test card. 

6. Inversion (Reverse Repetition).—S is shown, one at a time, a 
series of ten words which increase in length and structural complexity. 
S pronounces and spells the exposed word. The card is removed and S 
is asked to spell the word backwards. 

7. Association (Treffer Method).—This series consists of ten sets 
of paired concrete designs or abstract signs, one of each pair red and the 
other black. S is shown successively the pairs of each set and is then 
shown a card on which the designs are reproduced, the reds on one side 
and the blacks on the other. S is supposed to couple them as they 
appeared in the original pairs. The number of pairs in successive sets 
increases from two to six. ! 

8. Story Arrangement.—S is shown, one at a time, ten sets of pic- 
tures. He is asked to arrange the pictures of each set in a logical order 
and relate the story they depict. The number of pictures of the ten 
sets varies without consistent increase. The increasing difficulty of 
the stories is based on the abstract quality of the idens depicted. 

9. Absurdities.—S is asked to point out the absurdities in each of 
ten pictures. The absurdities increase in complexity. 

10. Problems.—Ten arithmetical reasoning problems are presented 

(in print) in order of increasing difficulty, with spaces provided for 
writing the answers. 

11. Analysis.—S is asked to imagine a specified familiar object and 
to name a designated number of its principal parts. The progressive 
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difficulty of this series depends upon the increasing complexity of the 
objects to be imagined and the number of parts to be enumerated. 

12. Naming.—E names three species for which S must name the 
genus (animal, vegetable, clothing) ; or, Z states an action which S must 
qualify. 

13. Reconstruction.—S is required to complete a series of ten incom- 
plete drawings which increase in difficulty according to the complexity 
of the picture and the amount of completion necessary. 

14. Practical Solutions.—Ten situations are described which present 
increasingly difficult practical problems for S to solve. 

15. Puzzles.—This test requires the fitting together of five picture 
puzzles, the reproduction of three geometric designs, and the arrange- 
ment of two Healy and Fernald formboards. 

S receives a score on each of the fifteen tests according to the number 
of the most difficult item passed. Since there are ten items in each test, 
the total possible score is one hundred fifty points. The graduation in 
the order of increasing difficulty in a series of items was done first 
purely a priori and on the basis of simple probabilities. It was neces- 
sary, of course, to make some changes after giving a number of trial 
tests in order to maintain the graduation. 


TRANSLATION FROM HEINIS 


[The following is a translation of the first part of Heinis’ article in which he 
evaluates and applies the procedure and data presented in the article by Ver- 
meylen from which the preceding scale was abstracted.] 


What interests us particularly in this study* are the results obtained 
on the sixty normal children between six and twelve years, because we 
find realized here experimental conditions which may serve our purpose. 
The number of the subjects is small, but the quality of the data largely 
compensates for their meagerness. The division of the examination 
into two sittings separated by a forty-eight-hour interval, and the use 
of a total testing period three times as long as that which Binet believed 
sufficient for this kind of examination, are by themselves signs of good 
precision. Furthermore, the children were chosen from a homogeneous 
social environment which favored average mental “growth.” The 
children attended the same school and came from families of the small 
bourgeoisie in the center of Paris. The author (Vermeylen) has chosen 
only ten subjects from each grade with no concern for their school 





* Heinis refers to Vermeylen’s study.—Translators’ note. 
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success, with the sole condition “‘that they have the mean age of the 
class.”’ 

He speaks further of the scale in these terms:* ‘‘ Following the plan 
of the Yerkes-Bridges ‘point scale’ we have laid out a mean scale of 
points obtained for each child in the fifteen series of graduated items, 
Then we have calculated the mean of these points for all the children 
of the same age.” 

We cannot subscribe to the use of this last procedure on so small a 
number of subjects because the means are too much affected by the 
extreme cases. It would certainly be better to express the central 
tendency by the median. It is fortunate that Dr. Vermeylen has 
illustrated his article by the graphs of each of the sixty subjects so that 
we are able to make certain corrections. To facilitate comparison we 
have tabulated the means taken from Vermeylen’s Graph 1 and below 
them have added the medians. 

As shown here by the “differences,”’ the two results do not agree 
entirely; it would be useless then to push the precision to the point of 
entering the decimals as Dr. Vermeylen has done. 

Considering the general contour of the individual graphs the author 
(Vermeylen) concludes: “As the children progress in age, the curves 
become more and more regular and tend toward the horizontal.” 
This is only apparently so and suggests that the graduation of the tests 
has been artificially stopped at year ten. The method does not permit 
the differentiation of the scores of older subjects. To prove this it is 
sufficient to construct a frequency curve for each age based on the 
number of points obtained by the students for each of the fifteen tests. 
It is Graph 9, pages 112-123, of Vermeylen which has been used 
for the elaboration of Table II and the Figs. 1-6. 

Table II shows by the increase at ten that the conditions are satisfactory for 
measuring the ages six to ten years, and that they are satisfactory for all but the 
extreme cases between ten and eleven years, but that they are insufficient beyond 
that age. Among the seventy scores of ten there are a good number which would 
have been higher, eleven, twelve, or thirteen, had such scores existed. In view 
of the score distribution at age eleven to twelve (Table II), this excess can approxi- 
mately be calculated and the median corrected. It is easy to deduce from the 


trend of the score distribution for each age that the mode is nearer nine than ten, 
and it follows that the number of cases n corresponding to the score ten is confined 





* Vermeylen: Op. cit., p. 50 (Heinis’ footnote). 

t These figures are not presented here since the data are directly obtainable 
from Table II. Further translation has been modified accordingly.—Translators’ 
note. 
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Taste I.—(Hern1s) 
Age 6-7 7-8 8-9 910 | 10-11 | 11-12 
ee Grek ie kote ston teie 58 74 99 112 130 138 
ed i be oa bas 0 vo beak 56 80 99 113 130 138 
TE isc indice cute ete 2 6 0 1 0 0 
within the limits 
27 <n < 48. 


The excess would be about thirty and would be distributed under the scores 
eleven, twelve, and even thirteen, which would augment by 3.5 points the score 
obtained by each of the subjects from eleven to twelve years. The true central 














tendency would be represented by the median 141.5 and not 138. (See Table I.) 
Tasie II.*—Scorg 1n Tests (Herts) 

Ages o/1/2/3)4]/516]7]81]9 1] 10] 11/12 
6-7. .| 5 | 12) 22) 23 | 31 | 27 | 24) 6 
7-8. 1; 5 13 | 35 | 35 | 29; 28; 2) 2 
Pi vvesseneras sat 4/17 | 47) 51 | 26 5 
Se 5 | 28 | 45 | 36 | 28; 8 
10-11. 3 4/11 | 42 | 52) 38 
es ae 5 | 27 | 48 | 70 
11-12 as extended. . 5 | 27 | 48 | 42 | 22| 6 












































* With ten subjects at each age level taking the fifteen tests, there are one 
hundred fifty scores at each level. Their values range from zero to ten and are 
here tabulated according to frequency.—Translators’ note. 


This established, one could construct a graph of the six median 
values. Let us imagine the sum of the points on the ordinate and the 
ages on the abscissa. For simplification, the numbers indicating the 
years could be reduced to decimal numbers multiplied by ten; thus 
six and five-tenths years would be represented by the the number sixty- 
five. This suffices to fix the points as shown in the table at the top 
of page 506. 

This sequence presents a regular curve. Whichone? For simplifi- 
cation, we are omitting all the mathematical deductions which were 
necessitated in these investigations and are limiting ourselves only to 
the indication of the result. The curve is represented by the logarithm 


y =a + be! 
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Age Age number Median 
Ps 6.5 65 56 
P, 7.5 75 80 
Ps 8.5 85 99 
P, 9.5 95 113 
Pr 10.5 105 130 
Py 11.5 115 141.5 














where a, b, and d represent constant values and e is the base of the 
natural logarithm. To determine the value of the three constants, it is 
advisable to choose those points which are the most exactly defined, 
that is to say, those where the median and the mean coincide, which are 
Pzand P;;. Let us add to these the most distant point, Ps, and a very 
simple calculation results in the values: 


a= 218.5, b= —429.0, d= —66.75 


Then the three points are situated on the logarithm 


y = 218.5 — 429¢ %75 


Let us now find how the other points, P;, Ps», and Po, lie with respect 
to the curve. Let us calculate the values of y for z = 75, x = 95, and 
x = 105, and compare these with the values experimentally found. 


Tas.Le III].—Nvumper or Points (HEIN1s) 








Age i ga Calculated Difference Per cent 

7- 8 80 79 1 1.2 

9-10 113 115 2 1.7 
10-11 130 129.5 0.5 0.4 

















In Table III we note that the calculated value is one point lower for 
P, and five-tenths lower for Ps. But these are negligible quantities if 
one considers the small number of subjects on which the mean has been 
established. Besides, a simple inspection of Table II will satisfactorily 
confirm this point of view. In particular the row for children seven to 
eight years and, even more so, that of children nine to ten years shows 
less homogeneity than the four others, so that the values seventy-nine 
and one hundred fifteen agree at least as closely as do the medians 
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with the central tendency of the two ages. We cannot, then, doubt 
these theoretically found values, and we can conclude that the above 
formula is the most probable expression of the development of intelligence 
between six and twelve years. 

The consideration of the curve which represents the logarithm out- 
side of these limits leads to discussion. Two parts are distinguished 
here: The part corresponding to the ages four and five-tenths to twelve 
years, that which we may call “empirical” since the results can be 
obtained from the Vermeylen data, and the part corresponding to the 
other years, or the “theoretical’’ one. 

To judge by the empirical segment, it is only above four and five- 
tenths years that the child is capable of passing any of the tests. 
Applied to subjects of five years the method leads to more appreciable 
results. It ceases to exist for ages greater than eleven years. 

The mathematical formula permits us to anticipate the theoretical 
part by the simple interpretation of the following values: 
for 


x = 45, y=0 
for 
xz =0, y = —210.5 


That is to say, no item can be normally passed by children less than 
four and five-tenths years of age; the first one is already too difficult for 
them. Then, to give a method accessible for that age, we must com- 
plete each series of tests by items still easier. It is necessary to deter- 
mine their number. Let us suppose that the scores obtained by the 
Vermeylen procedure are scores spaced by psychologically equal 
distances—that which in the main can be admitted. All the theoretical 
scores are indicated as being spaced by psychologically equal distances. 
Then the 210.5 points which correspond to the ages from birth to four 
and five-tenths years, and which are lacking, can be obtained by adding 


to each of the fifteen tests a series of ci = 14items graduated accord- 





ing to increasing difficulty. The score one of Vermeylen would thus 
become on the average the score fifteen in the new series of items con- 
stituting each test. This same reasoning applied to the number of 
theoretical points to be attributed to the ages superior to twelve years 


shows us that the graduation of the same tests can be continued to the 
218.5 — 141 





height of ib = § items marking psychological distances 
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equal to the preceding. The new test would comprise not ten, but at I 
least 14 + 10 + 5 = 29 items. Psychologically speaking a measure imm 
thus elaborated would constitute a standard test of absolute and fixed year 
graduation and applicable to all ages. of in 
After reaching these conclusions, we must find a mathematica] is re 
. criterion for the rational scaling of the tests. Let us return to examine was 
the progress of the spiral development of intelligence by the aid of Fig. 
3 wember Bit 
ER RR age enemy ines ear ete 
3 nee - — Some 
ie - pe 0 
; : iq 2 ib 0- 
bi : 1- 
+ oe : 2. 
i . 100 F—- 3- 
th . 4- 
er s 
iy 4 - 
is : : 
ad o as Geen LOEB EREEe CARRS e eRe ee 7- 
: at : : , 40 20 50 Years g. 
Se we. 9 
ae | ace 10 
ia te il. 
é wok ! 12. 
¢ s ; 13- 
: F = moment of fecundation 14. 
: " of ovun 15 
16 
a a 17 
| eee a 18 
i Fia. 7.—Graphic representation of the law of mental development. (Heinis.) 19 


es 7. From the more ample information, we can sum up in Table IV the 

} values of y for the mean of each age and show the differences between : 
consecutive ages. In the fourth column the same y’s are expressed deve 
in absolute degrees. 

To judge from these results, human intelligence does not normally 

Le cease to develop during life from birth up to the moment when the 
destructive action of old age begins. However, the progress, although 


whe 
remaining positive, becomes less and less, until finally at twenty-five wad 
years development is practically achieved. Beyond this year and for exp 


the rest of life we travel no greater a psychological distance than that 
achieved in the single year from twelve to thirteen years. 


¥ 
a 
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By the graphical method of Fig. 7 we have established both the 
immense pychological evolution that we achieve during the first five 
years of our existence (half of the total development)? and the constancy 
of intellectual maturity up to forty years. A segment of especial value 
is revealed—that which corresponds to the period of puberty—which 
was until now unknown. 


Taste I[V.—(Heris) 








hen - Differ- | Absolute Age > Differ- | Absolute 
ence degree ence degree 
0 —210.5 shea 0 20-21 198.6 2.8 409.1 
0- 1 —179.5 55.4 30.9 21-22 201.4 2.4 411.9 
1- 2 | —124.1 | 47.7 86.3 22-23 | 203.8 2.0 414.3 
2-3 | — 76.4; 41.1 131.0 23-24 | 205.8 1.8 416.3 
3- 4 — 35.4 35.3 175.1 24-25 207 .6 1.5 418.1 
4-5 | — 0.1] 30.4 210.4 25-26 | 209.1 1.3 419.6 
5- 6 30.3} 26.2 240.8 26-27 | 210.4 1.2 420.9 
6- 7 56.5 | 22.5 267 .0 27-28 | 211.6 0.9 422.1 
7-8 79.0} 19.5 289.5 28-29 | 212.5 0.8 423 .0 
8- 9 98.5 | 16.6 309.0 29-30 | 213.3 0.8 423.8 
9-10 115.1 14.4 325 .6 30-31 214.1 0.6 424.6 
10-11 129.5 | 12.3 340.0 31-32 | 214.7 0.6 425.2 
11-12 141.8 10.7 352.3 32-33 215.2 0.4 425.7 
12-13 152.6 9.2 363 .0 33-34 215.6 0.4 426.1 
13-14 161.7 7.9 372.2 34-35 | 216.0 0.3 426.5 
14-15 169.6 6.8 380.1 35-36 | 216.3 0.3 426.8 
15-16 176.4 5.9 386 .9 36-37 | 216.6 0.2 427.1 
16-17 182.3 5.0 392.8 37-38 | 216.8 0.3 427.3 
17-18 187.3 4.4 397.8 38-39 | 217.1 0.2 427.6 
18-19 191.7 3.7 402.2 39-40 | 217.3 0.2 427.8 
19-20 195.4 3.2 405.9 40— «0 218.5 429.0 


























In order to be more precise we may say that. the trend of mental 
development is that of the logarithmic curve 


| 


y=a—be 


where a, b, d are constant and positive values, and e is the base of the 
natural logarithm. By the aid of an easy transformation, y can be 
expressed according to the formula 


y=a—bQ" 








eS 


* ui 


a ee 








ft 
b 
€ 





510 The Journal of Educational Psychology 
Let 7 be a particular age and (i + 1) be the following age, then 


Yin — YW = a — DQ — (a — 1Q*) 
= bQ- — bQ-t» 


It is this last equality which we use to establish the law of the develop- 
ment of intelligence: The quantitative development of intelligence from 
one year to the next is equal to the difference between two consecutive 
terms of a geometrically increasing progression. 


TRANSLATORS’ DISCUSSION 


In presenting the scale of fifteen tests, ten items each, Vermeylen 
indicated that the items of each test progressed according to increasing 
difficulty. The basis of such an increase is implied in his discussion 
of graduating the items when he says that the a priori arrangement 
gave way to changes after a number of trial tests. Just what methods 
were used cannot be determined and how strictly his criteria were 
followed is not known. Inspection of the items of each test throws two 
points in question: 

1. the steepness of the increasing difficulty of items; 

2. the equality of steps between items. 

We have no way of knowing that these points were not amply 
considered when the scale was set up, but lack of information along 
with the very nature of the items leads us to believe that the steepness 
varies markedly and that the steps are considerably unequal. Change 
in steepness of item increase from test to test is acceptable if it is 
accompanied by correspondingly increased difficulty for all ages to be 
tested. If the test curve rises quickly and flattens out, it is not a 
test of the higher abilities of older children. Since later extension of 
test items by Heinis requires that scores, and hence steps, be psycho- 
logically equal, proof: of such equality should be offered. Heinis 
writes that the equality can in the main be admitted, but offers no 
evidence for proof. Indeed, such proof is difficult to maintain, and, 
if the equality cannot be shown, insistence on a procedure which 
necessitates it will ordinarily bring criticism. 

Vermeylen’s choice of tests for his intelligence scale may be ques- 
tioned. A consideration of the tests shows that the majority of 
them, especially the first half of the series, are testing specific abilities 
rather than general adaptation to practical situations such as the Binet 
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scale tests. One might also question Heinis’ statement that the 
length of time required for administering the Vermeylen scale indicates 
its precision. 

Heinis’ adaptation of Vermeylen’s results through extension in 
the upper levels to include scores eleven, twelve, and probably thirteen, 
may be supported on the basis of the trend of the scores for the lower 
ages and the obvious bunching at the level of score ten. The choice 
of having approximately forty cases in score ten with thirty to be 
distributed over eleven and twelve can be followed, but how the 
median is increased by three and five-tenths points is not obvious, 
since it is scarcely possible that each subject’s score would be aug- 
mented by that amount inasmuch as the increase is dependent on the 
existing score. The means will be affected to that extent, but not 
necessarily the medians. 

After calculating the six medians, Heinis fits a logarithmic curve 
to them presenting only the final equation and none of the mathe- 
matical procedure which is sometimes sought by students of the 
personal constant. To obtain the values for the constants in the 
equation, he uses P;, the point calculated by theoretical extension to 
scores of eleven and twelve. Nevertheless, the other three points 
(P:, Ps, P10), fall close to the curve, a fact which indicates the accepta- 
bility of choosing P11. 

Having found the empirical curve between six and twelve years, 
Heinis proceeds to obtain the parts below and above it through 
substituting appropriate values of z, that is, age points, in the logarith- 
mic equation. One must bear in mind that this entire curve is based 
on the results of but sixty children, ten at each of six age levels. 
Even if these sixty children had been thoroughly examined, it cannot 
yet be said that another sample of sixty would yield the same resu!ts. 
With statistics based as they are on large frequencies and probabilities, 
it seems questionable to make predictions on the basis of so few cases. 

The fact that the curve fits the median points for years six to twelve 
does not appear to be sufficient evidence that it will describe the areas 
below and above those limits. Investigations into other phases of 
human development indicate the irregularity of growth® and suggest 
the inadvisability of assuming the form of any segment of a growth 
curve from a preceding or succeeding segment. Heinis presents no 
evidence here that the theoretical points can be empirically found, 
although he calculates the number of items necessary for each test in 
order to provide a complete range of testing. 
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The application of the personal constant to Binet examination may 





be questioned, since it would seem to presuppose that mental develop. 
ment as measured by the Binet tests is similar to that measured by the f 
Vermeylen tests. Heinis does not mention in this article the applica- oni 
tion of the personal constant to the Binet scale. However, he com- dis 
ments at some length in a later part of the article on the lack of pas 
precision of metrical scales constructed as the Binet Scale is. od 


Despite the statistical and theoretical criticisms which may be 

. ; Pa ant 
made of the formulation of the personal constant, its superiority to Bu 
the IQ for prediction is on the whole supported by empirical evidence, on 
{ Heinis’ applied the method of the personal constant to Kuhlmann’s? fos 
i | results of Binet tests on feeble-minded children, and found that the PC foll 

was approximately constant for imbeciles, morons, and borderline 
subjects. Riley!? found the mean difference in IQ’s between the first 








irre 


; and final test over a period of years to be eleven points as contrasted ” 
14 with a mean difference of one point in the corresponding PC’s. 
th Hilden® found that the mean discrepancy between actual MA 1. 
“y and predicted MA of six hundred thirty-nine feeble-minded subjects 
i on the basis of IQ was as high as —5.91, while the use of the PC for 2. 
ty ‘ prediction resulted in a mean discrepancy of —1.08. The change . 
i | in the median IQ increased with the time interval; after one year it was 
i / —1.8 and after six years —7.8. The PC varied without trend from 4. 
4 | —1.0 after two years to +.05 after six years. Hilden’ reports in 
He another article that Baldwin and Stecher’s data converted into IQ 5. 
| and PC curves show the PC to be significantly more constant than P 
<| the IQ for superior and average children between the ages of eight ’ 
td and twelve. 
! ¢ MclIntire’s"! results with forty mentally deficient subjects examined a 
4 successively over a period of one to ten years are in general agreement 
he with the above studies. Cattell’ found that the PC was more con- . 
| stant than the IQ for children of sub-average intelligence, but that 
there was a tendency for the IQ to be slightly more constant than the §— 9. 
PC for children of superior intelligence. Hoakley® concludes from 
her findings that “in the extreme cases, mental ages predicted by the 
PC may vary as much or more than those prediced by the IQ but the 10. 
extreme difference of the middle fifty per cent of the cases is always iL. 
smaller than that for the IQ,” and that ‘‘the PC is a more constant 
and a more representative index than the IQ.” 12. 
As Kuhlmann” and others have pointed out, the chief value of the - 


PC over the IQ for prediction purposes seems to be that it provides 
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for the decrease in rate of development of individuals of below average 
mentality and for the increase in rate of development of those of 
above average mentality. However, the PC does not escape the 
criticisms which have been voiced against the IQ. The IQ is con- 
stant ‘on the average” for average individuals, and the personal 
constant is apparently constant ‘“‘on the average” for not only average 
individuals, but for superior and inferior individuals also. For groups 
and for the ‘‘usual” case, such indexes may be used to advantage. 
But in clinical application our interest is focused on the individual, 
and our main problem consists of making a diagnosis and prognosis 
for the unusual individual. Although growth curves of groups may 
follow mathematical formulas, the growth of individuals is often quite 
irregular and unpredictable, and all mathematical indexes may be of 
little value. 
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A CLASSROOM DEMONSTRATION OF “ATMOSPHERE 
3 EFFECT” IN REASONING 


SAUL B. SELLS AND HARRY F. KOOB 
Columbia University 


Few of the reported experiments on thought or reasoning have been 
found suitable for laboratory courses or classroom demonstrations. 
Some recent research at Columbia University on the general problem of 
mental set and directional influences in reasoning® has been adapted to 
classroom use with gratifying success. The present note is the first 
of several designed to make these procedures generally available. The 
literature on the problem of mental set in reasoning may be found in 
the discussions of Boring,' Rees and Israel,? Sells,* and Woodworth and 
Sells.‘ 

‘* Atmosphere effect’ is related to set, Einstellung, attitude, disposi- 
tion, determining tendency, directive tendency, halo effect, and per- 
severation. Jt is a set which arises within an individual, which is 
derived from and is specific to a particular problem. The individual 
is not necessarily aware of this set. The “atmosphere effect” occurs in 
problems or situations in which there is a closed series of responses 
related to a single task. The result of the “‘atmosphere effect’ is that 
the individual makes a response (e.g., an inference or judgment) which 
is most similar in quality to the general trend or tone of the whole 
situation set up. This is a psychological determiner of an individual’s 
response in a situation. 

The following classroom demonstration of ‘‘atmosphere effect” 
is not only a valuable aid to the instructor in presenting the concept of 
mental set in reasoning, but is highly interesting to the student as well. 
After the first section, A, which presents the procedure for the instruc- 
tor, the Test Sheet, B, the Record Sheet, C, and a brief discussion, 
including some results, D, follow. 


A. PROCEDURE 


1. Distribute the reasoning test (see B) to class. Follow routine 
testing procedure. Students are to comply with directions on page. 
Answer no questions on test. Time limit: approximately five minutes. 

2. Do not collect papers; have students turn over test papers on 
desks. Distribute Record Sheets (see C). Discuss the definition of 
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‘atmosphere effect” printed on Record Sheet, elaborating where 
necessary to coérdinate the material with the course. 
3. For further illustration of “atmosphere effect’’ present several 


examples, 


(a) 


(b) 


such as the following: 

Grammatical errors of number: A heedless speaker or 
writer frequently makes the verb agree in number with 
the general ‘“‘atmosphere” of the subject phrase, instead 
of the noun which is the formal subject*: 


The laboratory equipment in these situations were in many 
instances essentially the same as those used before. 

A common background of emotional conflict, repression, and 
abnormal reactions of a motor, visceral or perceptual nature have 
justified an inherent relationship. 

Here a series of experiments were conducted with a knowledge of 
results as the only supposed variables. 


Word Puzzles: Read the following questions to the class and 
have the students answer in unison: 
(1) What is the correct pronunciation of POLK? (Ans. 
poke, the l is silent) 
(2) How do you pronounce the word FOLK? (Ans. 
foke, the 1 is silent) 
(3) How do you pronounce the white of an egg? 
Even if they recognize that the third question refers to 
the white rather than to the yellow part of an egg, most 
students will either report or admit a strong tendency to 
respond with the word YOLK. 


4. Make up atmosphere table of class results, by taking the 
census of responses of each category of conclusions to each set of prem- 
ises. Types of conclusions may be readily identified by referring to 
notation described on Record Sheets. Have students record fre- 
quencies in appropriate cells of tables on Record Sheet. Place a 
duplicate table on blackboard. 


B. TEST SHEETT 


Fill in the blank spaces in the third line of each of the problems 
below, as in the following example: 





* The sentences presented here are quoted from the psychological literature. 
t The Test Sheet and the Record Sheet should be mimeographed. 
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a : Example: All of the students in Psychology are sophomores; And all sophomores 
a are interested in current events; Therefore students in Psychology 
Bek interested in current events. 























By The conclusion, correctly filled in, is ‘‘Therefore all students in 
Hee Psychology are interested in current events.”’ < 
| Work quickly. No questions will be answered until the test is over, 
eb 1. All z’s are y’s; si: 
ie fe And all y’s are 2’s; 
ef Therefore z’s 2’s. wee 
4 2. All z’s are y’s; 
ae And all z’s are z’s; — 
Fi Hi Therefore y’s z’s. 
We it 3. No 2’s are y’s; ba 
me | And no 2’s are 2’8; 
ih Therefore 2’s y’s. es. 
By 8 4. Some 2’s are y’s; 
3 And some y’s are z’s; 
a 4 Therefore 2z’s 2’s. 
mS 5. Some z’s are not y’s; 
Ia. And some 2z’s are not 2’s; 
a a Therefore 2’s y’s. 5 thr 
Wal hu 
ie | C. RECORD SHEET 
ek Definition and Description of ‘‘atmosphere effect.” Ent 
ye Definition.—The ‘‘atmosphere effect’ is a temporary set of the 
: individual, arising within a situation (e.g., problem), to complete a — 
file task with that one of several alternative responses (e.g., an inference or 
Lo judgment) which is most similar to the general trend or tone of the Pr 
iif whole situation (e.g., problem). 
i The ‘‘atmosphere effect’”’ is a mental set which arises within the i 
ae individual and which is derived from and is specific to a particular 
Hee problem. The individual is not necessarily aware of this set. The 
‘atmosphere effect”’ occurs in problems or situations in which there 
is a closed series of responses related to a single task. The result of the 
“atmosphere effect’ is that the individual makes a response (e.g., an peas 
inference or judgment) which is most similar in quality to the general 
trend or tone of the whole situation set up. This is a psychological mo 
determiner of an individual’s response in a situation. the 
LocicaL NoTaTION FOR INTERPRETATION OF ‘‘ ATMOSPHERE EFFECT” IN gre 
SyLLocistic REASONING mo 
A—Universal Affirmative. ll z’s are y’s. All—yes atmosphere. Wi 
E—Universal Negative. No 2’s are y’s. All—no atmosphere. the 
IJ—Particular Affirmative. Some 2z’s are y’s. Some—yes atmosphere. cal 


O—Particular Negative. Some z’s are not y’s. Some—no atmosphere. 
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y Conclusions 
Problem | Premises 
n A E I O None 
1 AA 
2 AA 
3 EE 
4 II 
5 00 
Number of students in class_____ 
D. DISCUSSION 
Tables I and II show the results obtained with one class of twenty- 
three students, and the combined results of five classes, totalling one 
hundred thirty-four students at Columbia College. 
TaBLE I.—ReEsPoNnsEs OF TWENTY-THREE STUDENTS TO TEST 
Entries Indicate the Number of Students Offering Each Type of Conclusion, or No 
ae Conclusion, to Each Set of Premises 
a 
or Conclusions 
he Problem | Premises 
A E I O None 
he 
1 AA 23 0 0 0 0 
a 2 AA 16 1 6 0 0 
he 3 EE 0 15 1 0 7 
re 4 II 0 0 19 0 4 
he 5 00 0 0 3 17 3 
an 
‘al The significance of these tables has been discussed at length in a 
“al monograph? which is readily accessible. It may be readily seen that 





the results demonstrate ‘‘atmosphere effect,’”’ since in each case the 
greatest frequency falls in the cell of the table where the conclusion is 
most similiar in quality to the premises from which it is drawn. 
With reference to the five problems in the test, it may be pointed out 
that both a valid A and a valid J conclusion are possible in problem one, 
only a valid J conclusion in problem two, and no possible valid conclu- 
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TaBLeE II.—ReEsponses oF OnE HunpreD TuirtTy-Four STUDENTS TO TzEsr 
Entries Indicate the Number of Students Offering Each Type of Conclusion, or No 
Conclusion, to Each Set of Premises 





Conclusions 














A I 
1 AA 133 0 1 0 0 
2 AA 104 1 26 0 3 
3 EE 3 88 23 4 13 
4 II 0 0 121 1 12 
5 0O 0 3 18 94 19 


Se EPL Pes = 




















sions in problems three, four, and five. The correct conclusions in 
problem 1 are ‘‘ All z’s are z’s” and ‘‘Some y’s are 2’s.””._ The correct 
conclusion in problem two is “‘Some y’s are z’s.”’ 

This demonstration has been timed at approximately twenty-five 
minutes in nine classes at Columbia College. The nature of the test 
material, syllogisms, upon which this demonstration of ‘‘atmosphere 
effect” is based, restricts its use to students who have not had courses in 
logic, although not entirely, since forgetting of this type of material 
is frequently rapid. It is suggested that if there are any logic students 
in the class, the instructor treat these as a separate group. 
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A COMPARISON OF THE PERFORMANCE OF 
MATCHED GROUPS OF SCHIZOPHRENIC 
PATIENTS, NORMAL SUBJECTS, AND 
DELINQUENT SUBJECTS ON SOME 
ASPECTS OF THE STANFORD-BINET 


CHARLOTTE HALL ALTMAN AND DAVID SHAKOW* 
Worcester State Hospital, Worcester, Mass. 


Wells and Kelley,'! and Wentworth,? among others, have analyzed 
the successes and failures of psychotic patients on the Stanford-Binet 
examination. As far as can be determined, no attempt has been made, 
however, to match patients with normal subjects for mental age, and 
then to compare the performance of these ‘‘matched pairs” on the 
different sub-tests of the scale. In the present study, matched groups 
of schizophrenic patients, normal controls, and adult delinquents were 
compared in this way. It was found, when the data were scrutinized, 
that the patients tended to surpass their matched normal subjects in 
digit-repetition at the VII- (digits forward), XII- (digits backward), 
and XIV- (digits forward) year levels, in the induction test (XIV-2), 
the arithmetical reasoning test (XIV-5), picture interpretation 
(XII-7), reproduction of designs (X-3) and the code test (XVI-6). 
Their most marked relative success, however, was in the vocabulary 
test; they excelled in this at every age-level in which the test is given, 
showing marked superiority at the XII- and XVI-year levels. On the 
other hand, patients failed the absurdities test (X-2) much more fre- 
quently than the normals. Fable interpretation (XII-5 and XVI-2) 
and the Ball-and-Field test (VIII-1 and XII-3) likewise proved more 
difficult for patients than for either of the other groups. The deviation 
of the patients from the other subjects was, however, most pronounced in 
the vocabulary test. This is in accordance with the results of Wells and 
Kelley’ and Dearborn.*? Babcock,‘ on the basis of a similar finding, 
devised an efficiency index. Using the vocabulary test as the measure 
of pre-psychotic ability, she compared vocabulary level with the level 
achieved on a battery of tests emphasizing speed and efficiency of learn- 
ing. She reports on the use of the test with schizophrenic patients in a 
later publication.’ Schwartz,6 Wittman’ and Simmons*® are others 
who have made use of Babcock’s device or of a similar technique in 
testing psychotic patients. All of these workers report that differ- 





* From the Research Service of the Worcester State Hospital. 
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ences were found, always in the direction of superior vocabulary 
performance as contrasted with performance on other tests. A survey 
of the present material from the point of view of the discrepancy 
between vocabulary scores and scores on the other parts of the Stan- 
ford-Binet was therefore undertaken under conditions where the 
important factor of mental level was controlled. 


SUBJECTS 


The cases selected for this survey were all male, including schizo- 
phrenic patients, adult delinquents, tested routinely under the Briggs 
law (recidivists, or first offenders accused of capital crimes),!° and nor- 
mal controls, who were chiefly hospital employees and men especially 
hired as controls for a series of physiological and psychological tests. 
The Stanford-Binet intelligence scale was used. The codperation of 
the subjects was graded in each case by the examiner, a grade of A or 
B indicating that, in differing degrees, the subject was actively inter- 
ested in the tests and apparently exerted effort to do his best; a grade 
of C or D indicating that, in differing degrees, the subject was either 


TaBLE I.—ConsTANTS OF THE DISTRIBUTION OF CHRONOLOGICAL AGE AND 
EpvucaTion oF Firry-srxx Matcuep ScuizopHrenics, Normat SvusJEcts, 
AND DELINQUENT SuspsEects GivinGc REPRESENTATIVE RESULTS AND 
Tarrty Matcuep Susyects Grivinc NON-REPRESENTATIVE RESULTS 



























































Chronological age in years Education-grade attained 

Group No, | Mini-| Maxi-| srean| SD | No. Mini- | Maxi- Mean| SD 
mum /| mum mum | mum 
Representative results (A-B codperation) Representative results 

Schisophrenics............ 56 14 46 29.1 7.4 | 56 2 17 8.4] 2.7 
Normal subjects.......... 56 17 47 26.1 7.1) 56 4 14 9.2 2.3 
Delinquents............... 56 17 56 24.1 7.0 | 56 3 17 7.7 4.0 

Non-representative results (C-D codédperation) Non-representative results 
Schisophrenics............ 30 18 51 27.3 7.7 | 30 4 16 9.2 2.8 
Normal subjects!.......... 30 17 37 26.6 6.4 | 30 4 12 8.5 2.0 
Delinquents............... 30 16 56 26.5 9.0} 30 2 10 6.9 1.6 











1 Since no normal subjects of C-D codperation level were available, those with A-B level were 
used throughout for comparison. 
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apathetic and indifferent towards the test or antagonistic, exerting only 
perfunctory or spasmodic effort. All subjects selected were sufficiently 
codperative to make complete results on the examination possible, 
however. The subjects were divided into two groups, an A-B coéper- 
ation group and a C-D coéperation group. Test results on the A-B 
group were considered representative of the subject’s actual ability at 
the time of the administration of the test; results on the C-D group were 
not representative because of the poor coéperation given. In each of 
these groups, patients, normal subjects, and delinquents were matched 
individually for mental age on the complete Stanford. Since all of the 
normal subjects had coéperation grades of A or B, it was necessary 
to match some patients and delinquents of C-D codperation with 
normals of A-B coéperation. There were fifty-six subjects each in the 
patient, normal, and delinquent groups, matched for mental age and 
A-B coéperation; and thirty cases in each group with C-D codperation. 
Although no attempt was made to match the cases for chronological age 
and education, except to keep the whole group within the same general 
range, scrutiny of Table I will show that the groups did not differ 
widely in these respects. 


TaBLE II].—ConsTaANTs OF THE DISTRIBUTION OF COMPLETE STANFORD-BINET 
MeEntTAL AGEs In Montus TOGETHER WITH INTERCORRELATIONS, OF 
MatcHep Groups OF ScHIZOPHRENICS, NorRMAL SUBJECTS, AND 
DELINQUENT Sussects Giving REPRESENTATIVE RESULTS, AND OF 
Matcrep Groups Grvina NON-REPRESENTATIVE RESULTS 





Mental age in months—complete Stanford-Binet 





Mini- | Maxi- 
mum | mum 


Group No. Mean; SD Intercorrelations 























Representative Results 





Schizophrenics............. 56 112 | 228 157.1} 25.9 | Patients vs. normals + .9993 
Normal subjects........... 56 111 228 | 157.0) 25.9 | Patients vs. delinquents + .9987 
Delinquents............... 56 111 222 | 157.0) 25.6 | Normals vs. delinquents + .9985 








Non-representative Results 





Schisophrenics............. 30 109 177 | 140.9) 17.7 | Patients os. normals + .9986 
Normal subjects........... 30 111 176'| 141.0) 17.5 | Patients vs. delinquents + .9864 
Delinquents............... 30 | 108] 177 | 141.1] 16.9 | Normals vs. delinquents + .9858 
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The success of the matching for Stanford mental age may be judged 
from Table II; in no case did the members of a matched trio differ from 
each other by more than six months of mental age; in most cases the 
difference was not greater than one month. 

The psychiatric sub-types of the patients in the two groups were as 
follows: In the ‘‘ Representative” group, hebephrenic, three cases; 
catatonic, seven; simple, five; paranoid, seventeen; mixed, four; late 
indeterminate, two; unclassified, eighteen. In the “‘ Non-representa- 
tive” group, hebephrenic, seven; catatonic, ten; simple, two; paranoid, 
two; late indeterminate, one; unclassified, eight. 


TECHNIQUE AND RESULTS 


In order to obtain a “discrepancy score” which would show the 
difference between the level attained on the vocabulary test alone, and 
performance on the remainder of the Stanford scale, the following 
procedure was used: The vocabulary scores were distributed for the 
“Representative” and the “Non-representative” groups separately, the 
deviation from the mean of the group in terms of standard deviation 
was computed for each subject, and may be called the standard 
deviation, or o-score on the vocabulary test. The Stanford examina- 
tion of each subject was then re-scored, omitting the vocabulary test 
and giving proportional credit to the other sub-tests at the age-levels 
where the vocabulary test occurs. These mental ages on the Stanford 
without the vocabulary test were similarly distributed, and ¢-scores 
obtained for the “‘ Representative” and for the “‘ Non-representative”’ 
groups separately. The o-scores in the ‘‘ Representative” group 
ranged from —2.505 to +2.667 on the vocabulary test, and from 
—2.268 to +2.633 on the Stanford without vocabulary. In the 
‘“Non-representative” group, the o-scores ranged from —2.023 to 
+2.784 on the vocabulary test, and from —2.403 to +2.136 on the 
Stanford without vocabulary.* The difference between the o-score 
on the vocabulary test and the o-score on the Stanford without the 
vocabulary was then considered to represent the discrepancy in per- 





*The mean absolute scores for vocabulary were: Representative group— 
Schizophrenics, 54.9; Normals, 49.3; Delinquents, 51.4; Non-representative 
group—Schizophrenics, 52.0; Normals, 40.8; Delinquents, 42.0. The mean 
absolute values in months for Stanford-Binet without vocabulary were: Repre- 
sentative group—Schizophrenics, 156.0; Normals, 158.0; Delinquents, 157.4; 
Non-representative group—Schizophrenics, 137.5; Normals, 142.0; Delinquents, 
141.7. 
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formance on vocabulary as opposed to other tests of the Stanford, and a 
discrepancy score thus obtained for each subject. The constants of 
the distributions of the discrepancy scores are given in Table III for 
patients, normal subjects, and delinquents separately, a plus score 
indicating a discrepancy in favor of the vocabulary. 


TaBLE IIJ].—CoNnsTANTS OF THE DISTRIBUTIONS OF DiscrREPANCY SCORES FOR 
Botan REPRESENTATIVE AND NON-RERPESENTATIVE MatTcHED GROUPS OF 
ScHIZOPHRENICS, Norma SuBJEcTs, AND DELINQUENT SUBJECTS 





Discrepancy scores 





Mini- | Maxi- 


eta Becenend 1Mean and SEy| SD and SEsp 


Group No. 




















Representative Results 








Schizophrenics........... 56 | —1.786| +1.927|+0.265 + 0.101{0.750 + 0.071 
Normal subjects......... 56 | —1.639| +1.739| —0.220 + 0.099 0.735 + 0.070 
Delinquents............. 56 —1. 767) +1. 668 —0.045 + 0.102,0.758 + 0.072 





Non-representative Results 





Schizophrenics........... 30 |—1.404'+3.012|+0.706 + 0.208/1.121 + 0.147 
Normal subjects......... 30 | —2.088| +2.183)-—0.398 + 0.158'0.851 + 0.112 
Delinquents............. 30 | —2.526|+1.098| —0.292 + 0.1690.908 + 0.119 


1 Plus scores indicate discrepancy in favor of vocabulary; minus scores in favor 
of the rest of the Stanford. 





In both the ‘‘ Representative” and the ‘‘ Non-representative” 
groups, the distributions show noteworthy differences among the three 
types of subjects used; these differences are particularly marked in the 
distributions of the ‘‘ Non-representative” group. In each case, the 
discrepancy scores of the normal subjects and delinquents overlap 
markedly; their means are all on the minus side, though the delinquents 
are closer to zero than the normal subjects (7.e., they show somewhat 
less discrepancy between scores). ‘The mean discrepancy scores of the 
schizophrenics, on the other hand, are both plus, indicating that their 
performance on the vocabulary test is relatively better than that of the 
other groups when compared with performance on the rest of the 
Stanford. 

In order to test the significance of the difference between these mean 
discrepancy scores and zero, Fisher’s ¢ test was used. The same test 
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was used to determine the significance of the difference between the 
mean scores of schizophrenics, normal subjects, and delinquents, 
The ¢’s, with their corresponding probabilities, are given in Table IV. 


TaBLeE [V.—SIGNIFICANCE oF DiscrEPANCY ScorEs OBTAINED IN Boru 
REPRESENTATIVE AND NON-REPRESENTATIVE MATCHED GROUPS OF 
ScHIzOPHRENIcS, NorMAL SuBJECTS, AND DELINQUENT SUBJECTS 





Fisher’s t—significance of discrepancy scores 

















Significance of difference Significance of differences between 
between mean score and zero mean scores 
Group | t | P Group | t | P 
Representative Results 
Schizophrenics . .|2.62| .01} Patients vs. normal controls. ...|3.28) <.002 
Normal subjects. |2 .22 03 Patients vs. jail cases.......... 2.15 .03 
Delinquents. .... 0.44) > .5) Normals vs. jail cases.......... 1.23 .23 








Non-representative Results 





Schizophrenics . .|3 .39} .002} Patients vs. normal controls... .|3.92} .0002 
Normal subjects. |2.52/.018] Patients vs. jail cases.......... 3.58) .0006 
Delinquents..... 1.73)|.100) Normals vs. jail cases.......... 0.44, .7>P>.6 





In both the “Representative” and the ‘‘ Non-representative” 
groups, then, the mean discrepancy scores are significantly different 
from zero for the schizophrenics and the normal subjects, but not for 
the delinquents. In both groups, too, the schizophrenics differ 
significantly from the normal subjects and from the delinquents. The 
normal and delinquent groups do not differ significantly from each other 
at either codperation level, however. Neyman and Pearson’s )-test"! 
was applied to determine whether any two of the distributions of 
samples could have been drawn from a common population with 
unspecified mean and standard deviation. The previous results were 
corroborated in each instance; again the schizophrenics differ signif- 
icantly from both the normals and the delinquents, while the difference 
between normals and delinquents is not significant. The schizo- 
phrenics were then tested against the normals and delinquents merged 


into one distribution. The )’s with their approximate P’s are given in 
Table V. 
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TasLE V.—NEYMAN AND PEARSON’S )-SIGNIFICANCE OF DIFFERENCE BETWEEN 
DISTRIBUTIONS OF DiscrEPANCY Scores OBTAINED IN Boro REPRESENTATIVE 
AND NON-REPRESENTATIVE MatcHep Groups or ScHIzOPHRENICS, NORMAL 
SuBJEcTs, AND DELINQUENT SvUBJECTS 





Group | » | P 





Representative Results 











Schizophrenics vs. normals.....................+000. .0034 | P<.0l 
Schizophrenics vs. delinquents.....................-. .0327 | .01<P<.05 
ee I, oon gdokodcenasaccccees .4539 | P>>.05 
Schizophrenics vs. merged normals and delinquents....| .0034 | P<<.0l 





Non-representative Results 





Schizophrenics vs. normals....................00008: .0001 P<.01 
Schizophrenics vs. delinquents....................... .0008 P<.01 
Dee oc an cncee daenes seescnces 8433 P>>.05 








Schizophrenics vs. merged normals and delinquents... .|.000008}) P<<.01 





Since the A-method tests the joint significance of the difference 
between both mean and standard deviation, thus extending the signif- 
icance of the differences between means found by Fisher’s ¢ method, it 
would seem that the findings may be accepted with considerable 
confidence. 

Having established a reliable difference between the discrepancy 
scores of schizophrenics and those of normal subjects and delinquents, 
some explanation of this difference in performance was sought. The 
greater discrepancy found in ‘‘non-representative”’ groups is an inter- 
esting, and quite significant, finding. It indicates that even when 
coéperation on the test is poor, the vocabulary test is affected relatively 
less, perhaps because it receives relatively greater attention and 
effort. This suggests that a vocabulary test, standardized as a separate 
test, might yield a better estimate of mental level than the complete 
Stanford Examination in less codperative psychotic patients. How- 
ever, variation in codperativeness on the various sub-tests of the Stan- 
ford, if present, can account for only part of the differences obtained. 
The delinquents of the same poor coéperation level did not show the 
superiority on the vocabulary test which was found in the schizo- 
phrenics; they, indeed, obtained a discrepancy score much like that of 
the normal subjects with whom they were matched, but whose results 
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were considered representative. Furthermore, in the schizophrenics, 
normals, and delinquents who give representative results, similar 
differences obtain, though they are somewhat less marked. 

In view of the results of Babcock and the others who have written 
on the subject (Schwartz, Wittman, and Simmons), it was at first 
believed that the discrepancy scores might represent the same kind of 
phenomenon which they have accepted as a measure of deterioration. 
If the discrepancy score is a valid measure of the difference between 
performance on a vocabulary test and on other tests, this would seem to 
be a reasonable assumption, even though tests ‘‘ which emphasize new 
learning and speed” (Babcock) were not used except as they are 
contained in the Stanford. To determine the validity of this assump- 
tion, various characteristics of the patient group were taken for com- 
parison. Period of hospitalization was tentatively considered as a 
possible criterion of deterioration, although its limitations as such a 
criterion were recognized. The coefficients of correlation between 
period of hospitalization and discrepancy score was +.09 for the 
schizophrenics giving representative results, and +.02 for the schizo- 
phrenics giving non-representative results. 

A more satisfactory criterion was sought in estimates of intellectual 
and of emotional deterioration submitted by the psychiatrists in charge 
of the patients. These estimates consisted of grades on a five-point 
scale, ranging from total absence of deterioration to very marked 
deterioration, made routinely together with grades on thirty-six other 
traits. These were made before the present study was begun, so that 
no question of bias on the part of the psychiatrists in making their 
ratings can arise. The results show entire lack of association between 
the estimates of deterioration and the discrepancy scores. This 
was as marked in the case of ratings of intellectual as of emotional 
deterioration. There is no evidence, therefore, insofar as the few 
measures used are concerned, that the discrepancy score is a measure of 
deterioration. 

Further clues as to the meaning of the discrepancy scores were 
sought in correlations of these scores with education and with chrono- 
logical age. Again there is no evidence of any direct association 
between the discrepancy scores and either of these variables; for 
schizophrenics, normal subjects, and delinquents, for representative as 
well as non-representative results, the correlations are all close to zero. 
It was further postulated that, if mental age on the complete Stanford is 
taken to represent present intellectual level, the degree of associa- 
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tion between present level and the discrepancy score might be informa- 
tive. Correlation coefficients were, therefore, computed for these two 
variables. They range from —.10 to —.50, both extremes coming 
from the normal group, the former from the cases matched with schizo- 
phrenics and delinquents giving representative results, the latter from 
the cases matched with schizophrenics and delinquents giving non- 
representative results. When one outlying case is omitted, even the 
correlation of —.50 drops to —.41. Variation in present intellectual 
level, therefore, accounts for very little—at most 14 per cent—of the 
variation in discrepancy score. It should be noted, though, that there 
is some spuriosity in these correlations, since the discrepancy score is 
probably some function of the mental age on the complete Stanford. 
It seems reasonable to assume that the true correlation between present 
intellectual level and discrepancy score would be even lower than those 
reported above. The correlations, however, are all in the “‘expected”’ 
direction, 7.e., the slight trend which does occur indicates that the 
subjects with the lowest mental ages show relatively better vocabulary 
performance than other subjects, and vice versa. 


DISCUSSION 


That there is a difference in the performance of psychotic and non- 
psychotic subjects on the vocabulary test as opposed to the other tests 
of the Stanford scale, seems to be definitely established. Our data, 
however, have adduced no evidence that the discrepancy in performance 
represents intellectual or emotional deterioration. In their reports, 
Babcock and Schwartz both indicate a relationship between the degree 
of deterioration and the efficiency index, but neither gives any correla- 
tion coefficients. Babcock distributes her cases according to efficiency 
index, then discusses the increase in deterioration in successive arrays 
of increasing ‘‘inefficiency.”” Schwartz presents a graph showing the 
association between period of hospitalization and efficiency index, but 
it is evidently a graph of the means of the arrays only. It is not possi- 
ble to determine the extent of the scatter around these means, but from 
the great irregularity of the graph one would judge that the scatter is 
large (e.g. the mean efficiency index is the same for patients hospitalized 
for two and for fourteen years). The relationship is clearly present, 
even if it is a loose one, however. It may well be that the failure of the 
present findings to substantiate those of Babcock and Schwartz is due 
to the fact that the discrepancy score is not strictly comparable to 
Babcock’s efficiency index. In any case, it seems clear that the 
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obtained discrepancy scores do not measure deterioration as it is at 
present clinically defined. 

On the other hand, it seems equally evident that relatively high 
discrepancy scores are a distinguishing feature of schizophrenic patients, 
Further investigation of the problem is needed and might well give clues 
leading to a better understanding of schizophrenic thought processes, 
The kinds of tests on which schizophrenics differ markedly in perform- 
ance from normal people of the same mental age may lead to some 
elucidation of the kinds of mental activity which characterizes them. 
When the differences can be demonstrated to be statistically reliable, as 
in the present case, when better criteria of psychiatric concepts, such as 
deterioration, are available, and when results of a number of similar and 
related investigations are compared and integrated, studies such as the 
present offer hope that they may form the basis for an objective meas- 
ure of some aspects of schizophrenic mental activity. 


SUMMARY 


The object of the present inquiry was to compare the vocabulary 
level with the general intellectual level in psychotic and non-psychotic 
subjects. Two groups of schizophrenic patients, normal subjects, and 
adult delinquents were matched for mental age on the Stanford. The 
first group included subjects of A or B coéperation level whose test 
results were considered representative of the subject’s ability at the 
time of the test; the second, those of C or D coéperation, whose results 
were not considered representative. The Stanford vocabulary scores of 
each group were distributed, and the score of each individual was 
expressed in terms of deviation from the mean in standard-deviational 
units. Similarly, o-scores on the remainder of the Stanford, with the 
vocabulary test omitted, were obtained. The difference between these 
o-scores, termed the “‘discrepancy score,’’ was considered to represent 
the relative performance on the vocabulary test, as compared to 
performance on the rest of the Stanford. In both coéperation groups, 
schizophrenics were found to have higher discrepancy scores (indicating 
relatively better vocabulary ratings) than either normal subjects or 
delinquents. The differences were found to be statistically significant 
in both instances. No association between discrepancy scores and 
three different criter:a of deterioration could be established. The 
scores, then, probably do not represent degree of deterioration in the 
schizophrenics, as Babcock’s ‘efficiency index” is presumed to do. 
Further investigation may show that the discrepancy scores are 4 
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measure of some aspect of “thinking disturbance” in schizophrenics, 
related or unrelated to deterioration. 
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CERTAIN ASPECTS OF THE VALIDITY OF THE 
BERNREUTER PERSONALITY INVENTORY 


WALTER F. ST. CLAIR AND J. CONRAD SEEGERS 
Temple University 


Because of the emphasis lately placed upon personality analysis 
both in educational institutions and elsewhere, and because of the 
frequent use of the Bernreuter Personality Inventory in this work, 
considerable interest has been manifested in the Inventory, which 
has been attacked and defended in a number of recent publications. 

The Bernreuter Personality Inventory attempts to measure four 
separate and distinct aspects of personality, or ‘‘traits,’’ at one time. 
It is this rather unique characteristic which recommends it to certain 
individuals but which has been attacked most vigorously by others. 
The separate sections or instruments of the Inventory, it is claimed, 
measure, separately and simultaneously, ‘‘Neurotic Tendency,” 
“Self-Sufficiency,” “Introversion-Extroversion,” and ‘‘Dominance-Sub- 
mission.”” On the basis of intercorrelation of the test items and 
correlations between the Inventory and certain other published 
instruments which purported to measure specific traits, Bernreuter 
has stated that there seems reason to believe that definite and distinct 
personality traits, which exist as separate entities, are measured by 
the Inventory.' More recently? he has suggested that possibly 
only three distinct traits emerge as the result of applying the inventory, 
stating that the measures of ‘Neurotic Tendency” and of “ Intro- 
version”’ cannot be clearly distinguished. 

The attacks upon the Bernreuter Personality Inventory may be 
illustrated by the contentions of Lorge and of Flanagan. Lorge 
has criticized® the validation of the Inventory through intercorrelation 
of the test items, stating that his analyses indicate that the “‘correla- 
tions in the scores are attributable to the weighting system”’ inherent 
in the Inventory itself. He concludes that ‘‘probably not more than 
two independent traits can be used to account for the ‘traits’ of the 


1 Bernreuter, Robert G.: Manual for Personality Inventory. Stanford Uni- 
versity Press, 1935. : 

2 Bernreuter, Robert G.: “The Imbrication of Tests of Introversion-Extro- 
version and Neurotic Tendency.” Journal of Social Psychology, 1934, pp. 184-199. 

*Lorge, Irving: ‘‘Personality Traits by Fiat I. The Analysis of the Total 
Trait Scores and Keys of the Bernreuter Personality Inventory.” Journal of 
Educational Psychology, Vol. XXVI, April, 1935, pp. 273-278. 

530 














ysis 
the 
ork, 
ich 


‘our 
me. 
tain 
ers. 
ned, 
ny, ” 
sub- 
and 
shed 
uter 
inct 
| by 
ibly 
ory, 
\tro- 


y be 
orge 
tion 
rela- 
rent 
than 
f the 


Uni- 


»xtro- 
—199. 
Total 
nal of 





Bernreuter Personality Inventory 531 


Bernreuter.”’ Certainly, he insists, there are less than four distinct 
traits involved. 

In another publication, Lorge, Bernholz, and Sells! examine the 
interrelationship of “Yes,” ‘‘No,” and ‘?” responses by means of 
correlation technique. The article states that the low correlations 
discovered, taken with other evidence cited or presented, indicate 
that the Bernreuter Personality Inventory lacks reliability, con- 
sistency, and independence of trait measurement. A correction? 
withdrew this conclusion as it applied to the F1-C and F2-S scales of 
Flanagan. 

Flanagan’s* approach was by means of the multiple factor analysis. 
Briefly, he concluded that the scores on the four scales may be largely 
accounted for in terms of two factors. 

In a recent article,‘ Bernreuter presented evidence to the effect 
that what he calls a “‘line of preference” is clearly indicated in the 
answers obtained from college students to whom his Inventory was 
administered, that more than chance was operant in the results 
obtained, that evidently something was being definitely measured by 
the separate measures of the Inventory. 

It was partly because of this controversy, partly to try to discover 
what evidence something over one thousand Bernreuter scores pro- 
vided a personnel office, that the present study was conducted. 

This paper reports some findings derived from the administration 
of the Bernreuter test and certain other instruments to seven hundred 
twenty-nine men and four hundred thirty-three women freshmen 
in Temple University upon entrance, during the scholastic years 
1934-1935. This number included most of the entering freshmen. 
In addition to the Bernreuter a group of questionnaires was admin- 
istered in an attempt to elicit information from these freshmen con- 
cerning their health, home conditions, personal problems of various 
natures, previous interests and activities, and certain social attitudes. 





1Lorge, I., Bernholz, E., and Sells, S. B.: “‘Personality Traits by Fiat II. 
The Consistency of the Bernreuter Personality Inventory by the Bernreuter and 
Flanagan Keys.” Journal of Educational Psychology, Vol. XXVI, September, 
1935, pp. 427-434. 

2 Lorge, Irving: ‘‘Personality Traits by Fiat II. A Correction.” Journal of 
Educational Psychology, Vol. XXVI, December, 1935, pp. 652-654. 

* Flanagan, John C.: Factor Analysis in the Study of Personality. Stanford 
University Press, 1935, pp. 103. 

‘ Bernreuter, R. G.: ‘‘Chance and Personality Inventory Scores.” Journal 
of Educational Psychology, Vol. XXVI, April, 1935, pp. 279-283. 
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This information was gathered through the offices of the Deans of 
Women and Men and emphasis was placed upon the thought that the 
motive was to assist freshmen in adjusting themselves. Every 
effort was made to assure the students that the information would be 
kept confidential and to encourage frank and honest responses. 
Subsequent personal conferences with some forty per cent of the 
population of the study indicated that the responses were genuine. 

A percentile distribution of raw scores with reference to each 
Bernreuter trait was computed to determine the applicability of 
Bernreuter’s norms to this group. The difference between the two 
percentile distributions was noticeable, particularly in B3-J and B4-D. 


TaBLE I.—PERcENTILE Norms FOR BERNREUTER PERSONALITY INVENTORY 
AND Norms ESTABLISHED FOR TEMPLE FRESHMEN 
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Although there is sufficient evidence presented here to indicate that 
norms should be established for different levels of maturity, the 
differences are not sufficiently significant to affect this study greatly. 
Consequently, the published norms were employed in the tabulations 
following. ‘The actual difference is indicated in Table I. 

In the questionnaire responses certain situations developed which 
might lead one to expect abnormal personality traits or responses. 
The following paragraphs analyze the Bernreuter scores of the several 
groups concerned in these situations. Bernreuter scores are expressed 
in percentiles. Accordingly, in the case of a normal group, one would 
expect a median and a mean of fifty per cent, and one would assume 
that deviations from fifty per cent indicated some degree of abnor- 
mality. On the same assumption one would expect deviations in 
the scores of a group, when conditions are apparently conducive to 
abnormality, if the test measures personality traits. 

In the analysis the following procedure is employed. In each 
instance the arithmetic mean and median Bernreuter scores are dis- 
played for the group under discussion. In inspecting these figures 
it should be kept in mind that a normal group should have a mean 
of fifty per cent. 

Table II displays Bernreuter scores of one hundred students who 
in the questionnaire reported serious disagreement in their homes as 
indicated. In this table as in the following tables, means are stated 
in terms of the nearest whole number. In each of the tables in this 
paper column B1 lists scores in neurotic tendency, B2 scores in self- 
sufficiency, B3 scores in introversion-extroversion, B4 scores in 
dominance-submission. 

According to Bernreuter’s interpretation, a score above 50 in Bl 
indicates neurotic tendency; a score above 50 in B2 indicates either 
independence or withdrawal, a score below 50 dependence; a score 
above 50 in B3 indicates introversion, a score below 50 extroversion; 
a score above 50 in B4 indicates dominance, below 50 submission. 

In Table II in every case except that of disagreement between 
sister and self, the mean in B1 is higher than normal. Every median, 
including that of the group mentioned, is considerably higher than 
normal. This indicates significant neurotic tendency in each of the 
groups. The greatest deviation is indicated in the groups reporting 
disagreement between mother and self, brother and self, and brother 
and sister. 
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TaBLeE II.—Serious D1saGREEMENT IN HomE 








P Number 

Disagreement between = teat Bl B2 B3 B4 
Father and self.............. 15 Mean..... 60 61 61 56 
Median...| 58 75 58 58 

Mother and self............. 10 Mean..... 67 66 60 39 
Median...| 80 67 55 35 

Mother and father........... 30 Mean..... 55 51 52 49 
Median...| 56 50 52 53 

Brother and self............. 15 Mean..... 67 30 64 32 
Median...| 73 23 65 33 

Sister and self............... 9 Mean..... 49 42 53 55 
Median...| 63 35 55 65 

Brother and sister........... 6 Mean..... 68 38 65 25 
Median...| 80 35 70 10 

IN. ca <icn-0 ch ne bien 15 Mean..... 52 51 51 54 
Median...| 52 44 55 48 

ND. 6 0 anstie nce ws cece 100 Mean..... 57 49 57 47 
Median...| 59 46 56 45 























The B2 scores are above normal in some instances, below or normal 
in others. This score has never been interpreted exactly,! although 
Bernreuter has offered an interpretation referred to above. The 
figures in the table indicate no definite trend toward either self- 
sufficiency or dependence. 

Both means and medians of B3 are consistently above the norms. 
The highest scores are in cases of disagreement between brother and 
self, and between brother and sister. The fact that the last named 
is the highest is interesting, because the individual himself is not 
directly concerned. It might reflect the effect of a discordant environ- 
ment upon a sensitive nature. 

The actual distribution of most of the B4 scores is not indicated 
by the mean. The distributions were in most instances highly irregu- 
lar. Some were concave, with cases at the extremes. Most were 
multi-modal. Only in the cases of disagreement between mother 
and father, sister and self, brother and sister were the distributions 





1 Other evidence derived from the analyses of these scores indicates as a possible 
basis of interpretation the relation of B2 and the other scores of the inventory. 
The data, however, are not yet complete. It seems possible that high B2 scores 
accompanied by high Bl and B3 indicate withdrawal. 
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fairly indicated by the average. However, in the whole group of 
scores, lack of dominance is indicated. 

In general, it should be noted from Table II that students reporting 
disagreement in the home are indicated to be inclined toward neurotic 
tendency and introversion by the Bernreuter Inventory. However, 
it should be noted also that in each instance the small numbers 
minimize the significance of these figures. 


Tassie III.—Srupents Desiring INTERVIEWS 








Number 

Problems sf anit Bl B2 B3 B4 

PE is cus censeeaeeanden 44 Mean..... 59 49 57 48 
Median...| 63 46 60 47 

Family relations............. 5 Mean..... 73 55 73 45 
Median...| 75 55 83 48 

skies casts dsctucus 25 Mean..... 61 55 63 47 
Median...| 71 65 67 45 

Us asc cicse indies cesccaus 66 Mean..... 64 47 58 45 
Median...| 64 44 63 43 

Gea d dona bdo 64kaouen oe 19 Mean..... 58 55 60 52 
Median...| 72 68 65 58 

PR Gia bcaedeateeeneas 304 Mean..... 51 51 50 51 
Median...| 51 50 50 52 

Pb sdancccccce cess 463 Mean..... 54 51 53 49 
Median...| 56 49 52 4G 























Normally one should expect persons desiring interviews to manifest 
at least slightly neurotic tendencies, the degree varying with the 
nature of the problems. In Table III there is a consistent trend in 


this expected direction, except in the cases of students having financial - 


problems. The means for this group are at the normal level. But 
this also is what one should expect. Financial difficulties make no 
personal distinctions. The trends indicated are toward neurotic 
tendency and introversion. 

Again it is to be noted that the B2 scores present no clear-cut 
picture. The B4 scores are not truly indicative. The reason is 
indicated by the B4 section of Diagram 1. The mean is normal 
because the frequencies are heavy at the extremes, but the average 
deviation of individuals from the norm is considerable. This kind 
of distribution was typical of the B4 and B2 groups. It was not 
typical of B1 and B3. 
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In Table IV note the neurotic tendency indicated by the B1 scores 
of individuals who have had heart trouble or Infantile paralysis, 
Note also that in these groups the B4 scores indicate lack of dominance 
and the B2 scores are high. This seems to lend some credence to the 
suggestion previously advanced that high B2 scores, accompanied by 
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Diacram 1.—Percentile scores"on thefourf Bernreuter traits of students desiring inter- 
views‘concerning social problems. 


high Bl and B3 scores, indicate withdrawal, if one may assume that 
these diseases leave or carry with them physical effects conducive 
to a tendency of such nature. This assumption does not seem unrea- 
sonable. No significant departure from the norm is apparent in 


any other group in Table IV, possibly because the diseases incurred 
produced no lasting effects. 














ores 
ysis, 
ince 
the 
| by 


nter- 


that 
cive 
rea- 
t in 
rred 








Bernreuter Personality Inventory 537 
Taste [V.—Seriovus ILiNess 
: Number 

Type of illness ppc Bl B2 B3 B4 
Infantile paralysis........... 10 Mean..... 59 54 57 44 
Median...| 50 50 65 37 

Winn COs ns oo 6 08 ovine 31 Mean..... 61 54 62 43 
Median...| 68 62 68 39 

Scarlet fever..........cccc0. 130 Mean..... 51 46 51 49 
Median...} 51 44 51 53 

Other illmesses............... 193 Mean..... 50 48 49 50 
Median...| 49 45 49 50 

DO dec cebecens vuune 364 Mean..... 51 48 51 49 
Median...| 51 46 51 50 























TasLE V.—Srupents Havinc CHronic HEADACHES AND DiGEstTrIvE TROUBLES 








anne Bi | B2 | B3 | BA 

of cases 
DI onktdae cevcviccns 207 | Mean..... 63 43 62 39 
Median...| 69 40 66 36 
Digestive troubles........... 102 | Mean..... 66 42 65 37 
Median...| 71 40 70 32 
Do something about it....... 129 | Mean..... 60 43 59 41 
Median...| 64 41 62 40 
Do nothing about it......... 140 | Mean..... 66 43 65 37 
Median...| 71 41 69 32 
PR incines dent canes 269 | Mean..... 63 43 62 39 
Median...| 68 41 66 36 























Table V seems quite significant. The relationship between 
neurotic tendency and headaches or digestive disturbances is well 
known and obvious. Note that in each instance there are indications, 
from the scores, of neurotic tendency, introversion, dependence, and 
submission. Note also that those who reported efforts to find cures 
or remedies are much closer to the norms than those who reported an 
attitude of apathy. The evidence in this table would not warrant 
the conclusion that the Bernreuter Inventory is a complete and 
accurate individual measure, but it is a strong indication that the 
results obtained from that Inventory are significant. Table V is 


consistent with what one might reasonably expect of the group under 
consideration. 
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Tables VI and VII display the scores of students who held class or 
certain other elective offices in high school. 
scores are indicative of well-balanced personality, according to the 
Bernreuter norms. It is of interest—possibly of significance—to 
note that class secretaries recorded the lowest scores in dominance. 
General student government secretaries recorded higher scores. 


Throughout these 


TaBLeE VI.—Srupents Houpine Cuiass Orrices In Hieu ScHoou 



































Office Number Bl B2 B3 B4 
of cases 

RT MRR CET 8 38 68 Mean..... 45 52 44 53 
Median 45 58 40 56 
Vice president............... 52 Mean..... 48 51 47 55 
Median. . 53 51 50 55 
A AR eee er 47 Mean..... 55 39 49 47 
Median 59 27 48 49 
Re ae eT 38 Mean..... 46 48 47 55 
Median 50 46 43 53 
CR GE occ caves cuviccs 73 Mean..... 44 54 46 60 
Median 43 52 44 63 
pe eee 278 Mean..... 47 49 46 55 
Median 49 48 45 56 

TaBLE VII.—Srupents Houpine Orrices in StupENT GOVERNMENT IN Hic 

ScHOOL 
Office Number Bi | B2 | B3 | B4 
of cases 

DC Ss cUn 4 dss oto 0 che r 15 Mean..... 43 56 48 59 
Median 45 63 45 58 
Vice president............... 17 Mean..... 47 46 47 56 
Median 45 45 45 56 
DG idedeensekiveen 12 Mean..... 43 48 38 61 
Median 40 40 30 63 
CN. os aes kb ad bow eies 8 Mean..... 53 55 53 49 
Median 60 55 60 45 
a ai (8 eat ga geo 137 Mean..... 43 59 43 58 
Median 42 59 42 59 
J ee eer ee 189 Mean..... 44 56 44 59 
Median 43 56 43 59 























This should not be surprising to any one who knows the work usually 
performed by such officers. As one would expect, these students 
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display no marked tendency toward neuroticism or introversion, and 


they appear to be self-sufficient, slightly dominant. 


TasLe VIII.—Srupents Havinc Earnep Mongy PREVIOUSLY 








How much Number Bl B2 B3 B4 
of cases 

Bought clothes.............. 284 | Mean..... 51 52 51 51 
Median...| 49 51 48 51 

Spending money............. 403 | Mean..... 49 49 49 52 
Median...| 49 47 48 52 

Oe I, ccc ccccccens 56 | Mean..... 45 62 46 60 
Median...| 38 67 42 63 

Board out of home........... 42 | Mean..... 46 63 50 56 
Median 39 67 50 58 

Occasional contributions...... 147 | Mean..... 46 56 47 56 
Median. 44 57 44 60 

PE  cccdbbans 4ieeen 932 | Mean..... 49 52 49 53 
Median. . 47 52 48 54 























Table VIII shows the scores of students who earned money prior 
to entering the university. These scores are consistent in their 


trends. 


There is no indication of neurotic tendency, and self-suffi- 


ciency is indicated, as is a tendency in the direction of dominance. 
Of particular interest in this table are the scores of students who 
paid board. Their dominance and self-sufficiency scores are high, 
again an instance of the agreement of these scores with what one would 


expect to find. 


Taste [X.—Sroupents Havine Speecn Derects 








Number Bi | B2 | B38 | B4 

of cases 
50 Mean..... 57 45 56 41 
Median 61 43 58 44 























Table IX, displaying the scores of students having speech defects, 
indicates clearly a tendency toward neurotic tendency and introver- 


sion. 


tion of a retreating nature. 


The B2 and B4 scores are consistently low, probably an indica- 
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SUMMARY 


This paper has presented and analyzed Bernreuter scores of 
individuals who because of a history of certain factors might reasonably 
be expected in some degree to deviate from the norm. If the test 
measures personality traits the employment of such a population 
should indicate the fact. If the test scores exhibited no tendency 
at all or disagreed sharply with what one might reasonably expect, 
the validity of the test as a measure of personality traits might be 
justly questioned. 

In cases in which one would expect a neurotic tendency and 
introversion the mean and median scores were consistently above the 
50 percentile. There is no indication in the test scores of a differentia- 
tion between these traits, but there is a definite indication of the 
presence of a definite personality trait. Whether it be called neurotic 
tendency or introversion is another question. This evidence seems 
to substantiate Bernreuter’s contentions. 

In disagreement with Flanagan’s insistence that the Bernreuter 
measures only two personality factors, the evidence presented points 
to the conclusion that the B2 and B4 scales are not identical, but 
measure different traits. There is some indication that the B2 
scale may point out either self-sufficiency or withdrawal, but that 
it should be interpreted only in the light of the scores of the other 
portions of the Inventory, and that it needs further refinement. 
Flanagan has based his sociability scale partly upon the B2 scale. 
In this interpretation he reverses the sign, and calls the trait sociability, 
indicating the opposite of non-sociability or independence. It is 
difficult to see any real distinction between this trait and “with- 
drawal.” The evidence points very definitely to this interpretation 
only in certain combinations of scores. ‘‘Self-sufficiency” as a 
desirable confidence in one’s ability is apparently measured by this 
scale more often than is “withdrawal.” Nothing in this evidence 
lends support to the conclusion that only two traits are measured. 

The B4 scales were consistent with what would be expected from 
the nature of the several cases. The evidence indicates that it does 
measure dominance. 

The Bernreuter scale appears to have a degree of validity as a 
measure of personality traits. 
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THE USE OF SUBCORRELATION IN THE ANALYSIS 
OF NON-LINEAR OR NON-HOMOSCHEDASTIC 
CORRELATION CHARTS 


P. 8. DWYER 
University of Michigan 


The Pearsonian coefficient of correlation is a standard summary 
measure of the extent of linear trend. Its absolute value must be 
nearly unity if it is to be very useful in making individual predictions. 
A relatively small value may, however, show significant group tenden- 
cies, 7.e., the means of certain groups may be predicted with consider- 
able accuracy even though r is small. 

The correlation coefficients obtained in many of the researches 
in the fields of psychology and education are too small to be used as the 
bases of individual predictions, but they do establish many group 
tendencies. These group tendencies, when they appear, are usually 
demonstrated to the reader by a presentation of the correlation table 
itself or by a listing of the means and standard deviations of the col- 
umns (or rows) of the table. 

Each of these methods is unsatisfactory. If the first alternative is 
chosen the data are presented in crude and undigested form and con- 
siderable study is necessary to obtain a clear picture of the relations 
involved. Occasionally the author indicates the positions of means 
(and quartiles) in the various column (or row) distributions and this 
helps to some extent, but still there is no summary measure which can 
be used as a basis of comparison with other comparable data. Also, 
the space available for publication hardly warrants the inclusion of 
data in such undigested form. 

The choice of the second alternative leads to a similar criticism. 
The computation of means and sigmas does not provide an adequate 
summary measure which can be used as a basis of comparison. In 
addition the writers who use this method have a tendency to over- 
emphasize the significance of the group tendencies which they find, 
since the method is designed to emphasize the differences in the groups 
but it does not provide an unbiased measure of the importance of these 
differences. 

The Pearsonian coefficient, especially if supplemented by the stand- 
ard deviation of errors, is a reasonably satisfactory measure of predictive 
power (1) when the regression curve is linear (the means of the columns, 
or rows, lie on a straight line), (2) when the distribution is homo- 
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schedastic (the standard deviation of the rows, or columns, are the same) 
and (3) when the complete range of the data is used. In case the 
regression curve is not linear, it is customary to compute the more or 
less unsatisfactory correlation ratio. This measure cannot well be 
compared with measures based on linear assumptions nor is it adaptable 
to the elaborate technique which has been built up for linear 
distributions. 

It is proper to use the correlation coefficient for a non-homo- 
schedastic linear form if one desires only a summary measure of 
predictive power. Such a measure, however, is not useful if one desires 
to discover the variations in predictive power within the distribution. 
It is here suggested that these distributions may be broken up into 
subgroups which are approximately linear and homoschedastic and 
that the correlation coefficients of these subgroups, hereafter called 
subcorrelations, may be used in indicating the predictive power. The 
standard deviation of errors—an important supplementary measure 
of predictive power—can be computed from the subgroup. An 


TaBLE I.—CorRELATION CHART FOR AN ARBITRARY HETEROSCHEDASTIC 
DISTRIBUTION WITH THE MEANS AND STANDARD DeEviaTIons oF Its 
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illustration is givenin TableI. The correlation chart indicates approx- 
imate linearity, but a decided lack of homoschedasticity, since the 
three middle rows have much larger standard deviations than the 
remaining. ‘the extent to which linearity and homoschedasticity are 
attained may be discovered by an examination of the means and 
standard deviations of the rows as given at the right of the table. 

The correlation coefficient is found to be .50 with a corresponding 
standard deviation of errors of 1.46. Inspection shows the correlation 
in the first three rows, and that in the last three rows, is better than 
that in the micdle rows. We compute the correlation coefficients and 
the standard deviation of errors for these subgroups. 

A notation is needed to distinguish the various subgroups. We 
indicate by r(R:ki, . . . k,) the correlation coefficient obtained by 
using the rows whose class marks are ki, ko, . . . k,. Thus the cor- 
relations of the three selected subgroups are r(R:4, 3, 2),r(R: —1, 0, 1), 
and r(R: —2, —3, —4). The selection of columns could be indicated 


by r(C:ki, . . . k,). The standard deviation of errors is indicated by 
Si(R:k,, co 8 8 k,). 
For the three subgroups selected the results are 
r(R:—4, —3, —2) = .48 S.i(R:—4, —3, —2) = .94 
r(R:—1, 0, 1) = .16 S,(R:—1, 0, 1) = 1.72 
r(R:2, 3, 4) = 32 S,(R:2, 3, 4) = .99 


The standard deviations of errors give good indications of the 
variations of predictive power, but the subcorrelations, as they stand, 
are not so satisfactory. None of the subcorrelations is as large as the 
correlation coefficient itself. This decrease is due not so much to a 
decreased predictive power as to a decrease in range. 

In case a distribution is exactly linear, i.e., the means of all the rows 
are exactly on the line of regression, it is possible to derive a formula 
showing the relation between the correlation coefficient and any 
subcorrelation obtained by the selection of a subgroup of rows. Let 
r’ represent the correlation, o,’ and o2’ the standard deviations of the x 
and y variables and m’ the slope of the linear regression with r, 01, 72 and 
m the corresponding values of anysubcorrelation. The equationof the 
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in the case of a linear distribution, the subcorrelations can be readily 

















Sa eaenaaal 
ee nae 
ate ae 


Me ica D 
ne ig ad 


She 








Pe Ce a ae a —— ~ = - = — 
=~ . ~ neers its + 2h ang ra . we Se “ 
Ward : “ Breet) fo OMG as GOR, Ara Os MMS Leby, Steed tN pn ge 
= Sos aaa cacaaraaiaseit SS Se ny aR ae Se ee Be ne, ee tae ee 
FOR OR AAE a gla i Seay. ane sm Soar rer ere = eee =a ts ee oS eg a ae eee 
Gn One Sy oo ae a RS rx RM ss sae s sit st ket aes si 5 
—e - & ’ = > 7 ah Pt et oe, Vea gu ae. 
* . a a aes a4 yee RS q > ak . a 3 - c 
5 - af ne <3 x $e ees ‘ ae Le eek slg PIE yah 





544 The Journal of Educational Psychology 


computed from the correlation if the standard deviations of z and y 
are known in each case. 

The selection of a group of consecutive rows has a tendency to 
decrease 2, (and hence cz) without an equivalent decrease of o1, (and 
hence c,). Hence the general tendency of selection of a - roup of con- 
secutive rows is for a decrease in the value of r. The standard devia- 
tion of errors is not affected by such a change in range. 

It is frequently possible to form other linear homoschedastic 
subgroups which are not composed of consecutive rows, but in this case 
the reduction in scale does not necessarily trend in the direction of 


smaller r. In the case of the above problem the additional sub- 
correlations were computed. 


r[R:—1, 0, 1] = r(R:—4, —3, —2, 2, 3, 4) =.78; 
Si[R:—1, 0, 1] = .99 
r(R:—4, —3, 3,4) =.87; S,(R:—4, —3, 3,4) = .89 
r(R: —4, 4) = .90; Si(R: —4, 4) = .89 


The standard deviations of errors are better indicators of the 
predictive power of the subgroups than are the subcorrelations, 
although the subcorrelations are needed in obtaining the prediction 
equations (the original prediction equation could be used in the 
case of absolute linearity) and in estimating the standard deviations of 
errors. The fairest measure of correlation to use as a basis of com- 
parison with r = .50 would be obtained by correcting the subcorrela- 
tions for their restricted range. We assume a distribution which is 
the linear homoschedastic extension of the subdistribution and has its 
y standard deviation equal to that of the original distribution. The 
resulting values, which we characterize as corrected subcorrelations, 
are sometimes larger and sometimes smaller than the subcorrelations 
themselves. The assumption of homoschedasticity permits a more 
precise statement of the relationship between r’ and any subcorrela- 
tion r of it. In addition to the relation r = r’c2/c; deduced above we 
know that S; = S,’ where S; = o1+/1 — r? and S)’ = o1'+/1 — 1’? 80 
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This formula has been given previously, in somewhat different form, 
by Kelley' who refers to Pearson for a more general treatment. 

If y is predicted from z and subcorrelations are formed by selecting 
r ad 




















lumns, 1’ = dr= h 
weirs Ve2*(1 — r*) + 1? wii Ve'*(1 — 12) + 72 a a 
¢! « ~. The formula ” = 7—- 2 =F is useful in extending 


the range of a given homoschedastic distribution since it demands only 
the evaluation of a2’ of the extended distribution. It is possible to 
use it as a proper adjustment to the subcorrelations to make them 
comparable with the whole table. It gives 


r’'(R:—4, —3, —2) = .80 
r’(R:—1, 0,1) = .36 
r’'(R:4, 3, 2) = .64 
r’(R:—1, 0, 1] = .67 
r’'(R:—4, —3, 3, 4) = .71 
r’'(R:—4, 4) = .73 


The comparison of these values with the summary r = .50 gives a 
fair picture of the variation of the predictive power in the distribution, 
since these are values which would be obtained if the entire distribution 
were linearly homoschedastic according to the subgroup chosen. It is 
noticed that the correction sometimes results in an increase and some- 
times in a decrease. This depends upon the value of cz = o2/a2’. 
When o2 = o2’,ce = 1,andr’ =r. Whenas < o2’,ce < land?’ >r. 
When o2 >o2’, co >1 and r’ <r. If the subgroup is composed 
of consecutive rows o2 < oo’ and r’>r. From this we draw the 
conclusions: 

If any uncorrected correlation obtained from any group of consecu- 
tive rows is larger than the correlation coefficient, that increase in 
correlation is due to an increase in predictive power and not to a 
decrease in the range. If a more comparable measure of predictive 
power is needed this result should be corrected for range. 

If any uncorrected subcorrelation obtained from any group of 
consecutive rows is smaller than the correlation coefficient, it does not 
follow that such a decrease is due to a decrease in predictive power. 
If, when corrected for range, the subcorrelation is still smaller than the 
correlation, then a decreased predictive power is indicated. 





1 Kelley: Statistical Method, pp. 223-230. 
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The significance of the subcorrelations deserves a word since the 
subgroups may be composed of a relatively small number of cases, 
The probable error can be computed for each subcorrelation and, if not 
significant, the subcorrelation should not be used. The reader is also 
referred to Kelley.! 

It may appear at first that the use of subcorrelations may involve a 
great deal of additional work. The technique can be adjusted so that 
the amount of work is not hopeless. Zfd,*, as well as Zfd., has to be 


TaBLe II].—ComputTaTION OF THE SUBCORRELATIONS AND THE STANDARD 
DervIATIONS OF Errors oF LINEAR HomoscHEDASTIC SUBGROUPS 
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computed for every row. Columns we label d, f, Zfd:, (Zfdz)dy, 
fd,, Zfd.*, fd,? and entries are inserted for every row. It is then a 
simple matter to total these for any rows desired and to substitute in 
the formula 





1 Kelley: Statistical Method, pp. 314-316 
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n2fdsdy — (Zfdz)(Zfd,) 





”* [[ndfd.? — (2fd.)*IinBfd,? — (Bfd,)*]} 


The values of o1, 72, and S, are also obtainable from the entries indicated. 

Table II illustrates the method and shows how a nearly homo- 
schedastic but non-linear distribution can be broken up into linear 
trends. 

Inspection does not indicate whether the row whose class mark is 
—2 should be included with the rows above or those below. The result- 
ing subcorrelations show that it should be combined with the rows 
above it. The corresponding net decrease in the size of the standard 
deviation of errors verifies this conclusion. 

Two regression equations can now be computed from the uncor- 
rected correlations. In this manner the subcorrelation technique 
makes possible the use of linear regression equations in the case of 
non-linear correlation. 


SUMMARY 


A. The subcorrelation method is useful in analyzing correlation 
tables in which— 

(1) Linear trend is present but there is wide variation in the stand- 
ard deviations of the rows (or columns). 

(2) The standard deviations of the rows are nearly equal but the 
means do not lie on the same straight line. 

(3) Combination of (1) and (2). 

B. All subcorrelations can be used in computing the regression 
equations and the standard deviations of errors. They should not be 
used as measures of the relative predictive power of the subgroup unless 
they are corrected for range, although in case a consecutive subgroup is 
formed from a linear group, the appearance of a subcorrelation larger 
than the correlation coefficient must be attributed to a decidedly 
superior predictive power of that subgroup. 

The author was led to the idea of subcorrelation as a result of his 
study of the problem of predicting success in college. A standard 
predictive measure is high-school record. The correlation tables 
show that high-school record predicts better for the high group than it 
does for the lower groups as the charts are heteroschedastic and, to 
some extent, non-linear. The subcorrelation technique is suggested as 
a method of providing definite and comparable measures of such varia- 
tions of predictive power. It will be used in later papers dealing with 
the prediction of college success. 
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THE EFFECT OF THE KNOWLEDGE OF MARKS ON 
THE SUBSEQUENT ACHIEVEMENT OF COLLEGE 
STUDENTS 


PAUL J. FAY 
DePauw University 


In the majority of colleges and universities students are awarded 
open marks based on a letter system, such as A, B, C, D, and F, 
or based on a percentage system. In some institutions, however, 
actual marks are withheld from the students. They are told merely 
that their work is “satisfactory,” ‘“‘unsatisfactory,” or “failure.” 
This study is an attempt to compare objectively the effect of the open 
and closed marking systems on subsequent work in a psychology 
course. The effect was measured largely by acquisition of knowledge. 
Although there are other types of achievement more significant than 
acquisition of knowledge, this constitutes at least one important objec- 
tive of any college course. 

The experiment! was performed on a class in beginning psychology 
with a total enrollment of one hundred ninety-six. Seven members 
of the class were seniors; the rest were juniors or sophomores. For 
experimental purposes the class was divided into two groups; after 
discarding the names of students for whom data were incomplete the 
experimental group numbered eighty-nine and the control group 
ninety-six. 

The two groups were equated on the following bases: (1) The 
percentile ranks on the American Council on Education Psychological 
Examination for high-school graduates and college freshmen were 
computed. The mean intelligence percentile of the experimental 
group was sixty-three with a standard deviation of 23.5. The mean 
intelligence percentile of the control group was sixty-three with a 
standard deviation of 26.5. The median percentiles of the respective 
groups were sixty-five and sixty-seven. (2) The scores on the first 
monthly test in psychology served as the second criterion. The mean 
score of the experimental group was 103.3 with a standard deviation 
of 14.0. The mean score of the control group was 102.9 with a stand- 
ard deviation of 13.4. 

The lecture and quiz method was used in teaching the course. 
Twice each week the two groups met together for lectures. Each of 
the two instructors in charge of the course delivered one-half of the 
lectures. The same textbook assignments were made to all students. 





1 Warren C. Middleton coéperated in conducting the experiment. 
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Once each week the entire class was divided into eight quiz and dis- 
cussion sections. Each instructor conducted two experimental and 
two control sections. 

At the end of each four weeks a test consisting of one hundred 
twenty-five or one hundred fifty objectively scored items was given 
to all the students. A final examination of four hundred objectively 
scored items was given at the end of the semester. Members of 
experimental groups were informed that they could secure their marks 
on each four-weeks test in terms of A, B, C, D, and F, and they were 
given their decile ranks on the test. For experimental purposes the 
following arbitrary areas were adopted; A, seven per cent; B, fifteen 
per cent; C+, twenty-one per cent; C, thirty-five per cent; D, fifteen 
per cent; F, seven per cent.! 

No announcements concerning marks were made to the control 
group. To those students who inquired their marks were given in 
terms of P+ (satisfactory), D, and F. At the end of the first eight 
weeks the names of the D and F students of both groups were sent 
to the deans. Consequently, the actual experimental and control 
groups consisted of those students who received better than a D mark 
on the monthly test; they were so considered in computing the results. 

As far as possible the artificial conditions of a laboratory experi- 
ment were avoided. None of the students were aware that an experi- 
ment was being performed. No attempt was made to insure that 
students in the experimental group would learn their marks other 
than the announcement in class that they were available. Some 
students of the group did not ask about them. This, of course, tended 
to minimize the differences between the experimental and control 
groups, but, on the other hand, it avoided artificiality alien to a 
classroom situation.’ 

To render the scores of the monthly tests and of the final examina- 
tion comparable they were all converted into standard scores by 
means of Hull’s formula, X = K + SX;.* Consequently, the stand- 
ard scores for each test and for the final examination have a possible 
range of zero to one hundred, a mean of fifty, and a standard deviation of 
fourteen. These standard scores will be used in presenting the results. 





1 The actual distribution of scores on each of the four monthly tests and on the 
final examination approached closely that of the normal probability curve. 

*The marking system employed was that in effect at DePauw University. 
The students’ marks at DePauw are recorded with the registrar in terms of A, B, 
C+, C, D, and F, but the only marks given to the students are P+, D, and F. 

* Garrett, Henry E.: Statistics in Psychology and Education, pp. 282-283. 
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The mean scores of the experimental and control groups on each 
test and on the final examination are recorded in Table I; the standard 
error gm Of each mean; the difference between the mean scores of the 
experimental and control groups on each test and on the final examina- 
tion; the reliability of the difference in terms of the co, ; the difference 
between the mean scores of each group on the first test and on the final 
examination; and the reliability of this difference. These data are 
recorded for four groups of students: Those securing a mark of A, 
of B, of C+ and of C on the first test. 

The mean scores are shown graphically in Fig. 1. 

The average score of students receiving a grade of A on the first 
monthly test was less on the three subsequent tests. The control 
group, however, declined much more than the experimental group. 
On the final examination the experimental group surpassed its mean 
score on the initial test. There are sixty-two chances in one hundred 
that the increase is a true difference. The control group, on the other 
hand, secured a mean score 9.9 points smaller than its score on the first 
test. ‘There are one hundred chances in one hundred that this is a 
true difference. The experimental section receiving a C mark on the 
first test declined slightly on the third and fourth tests, but gained 
1.8 points on the final examination. There are ninety chances in 
one hundred that this is a true gain. The control group gained on the 
fourth test, but lost on the final examination. There are seventy-one 
chances in one hundred that it is a true loss. 

Students in the experimental group who received marks of B or C+ 
on the first test achieved less in the subsequent tests and in the final 
examination. There are one hundred chances in one hundred that 
the loss of the B students in the final examination is a true one and 
ninety-two chances in one hundred that the loss of the C+ students is 
atrueone. The B students in the control group gained slightly on the 
final examination. The C+ students in the control group lost on the 
final examination, but their decline was less than that of the experi- 
mental group. 

In other words, if students securing an A on the first test knew their 
marks, they apparently put forth extra effort to retain their positions. 
The C students in the experimental group attempted to improve their 
standing: The B and C+ students, on the other hand, were apparently 
satisfied, did not unduly exert themselves, and consequently declined 
relative to the rest of the class. 





1 The small number of subjects in the A, B, and C+ groups makes the measures 
of reliability for their means and differences of little or no significance. 
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The correlation of scores on the first test with those on the final 
examination were .71 for the seventy-three students of the experi- 
mental group and .60 for the seventy-seven students in the control 
group. When students were told their marks, they were more likely 
to retain on the final examination the relative positions they occupied 
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Fia. 1.—Mean scores of experimental and control groups by letter grades. 


on the first test. There are eighty-nine chances in one hundred that 
the difference between the two correlation coefficients is a true differ- 
ence. In reality, there is probably an even greater difference between 
them since they were both computed from partial distributions.’ 








1 Kelly’s formula, = = wo is obviously inapplicable in this case (see 
—r 


Garrett: Op. cit., p. 272). Some correction, however, would need to be made to 
obtain the r’s for more heterogeneous groups. 
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Students receiving D or F on the first test were eliminated. This 
indicates that the P+ system of marking tends to result in some con- 
fusion on the part of the students as to their actual achievement. 

Possibly, the most unsuspected effect of an open marking system is 
revealed by the correlation between intelligence percentiles and the 
gains on the final examination over scores on the first test. In reckon- 
ing the gains the score of each student on the first test was subtracted 
from his score on the final examination. Fifty was added to each of 
these differences to make them all positive numbers. The intelligence 
percentiles of each group were correlated with the gains in scores on 
the final examination over scores on the first test. In the experi- 
mental group an r of —.05 was obtained. In the control group the 
coefficient of correlation was .43, a significant relationship. There 
are one hundred chances in one hundred that the difference between 
the two r’s is a true one.! The correlation tables for the two groups, 
shown in Table II, reveal the reason for this difference. In the con- 
trol group the students of lower intelligence lacked the incentive of 
knowledge of their marks. Almost none of them increased their scores 
on the final examination. The higher intelligence of the other students 
helped keep them in the higher-score areas. In the experimental 
group, on the other hand, the students of lower intelligence increased 
their scores on the final examination to as great an extent as did the 
more intelligent students. 

Further study with larger numbers of subjects is needed before any 
definite conclusions regarding the comparative effect of the open and 
closed marking systems can be confidently stated. In spite of the 
obvious unreliability of the results in this study, the following tenta- 
tive conclusions, however, are offered: 

(1) A students tend to achieve much more throughout the semes- 
ter, if they know their marks. 

(2) B students tend to achieve much less during the semester, if 
they know their marks. 

(3) C students tend to achieve slightly more on the final examina- 
tion, if they know their marks. 

(4) A closed marking system tends to confuse students as to their 
actual achievement. 

(5) Students of lower intelligence particularly need a knowledge of 
their marks as an incentive to increased achievement. 





1This difference likewise would probably be greater if more heterogeneous 
groups had been used. 
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BOOK REVIEWS 


CHARLOTTE BUEHLER and HitpEeGarD Hetzer. Testing Children’s 
Development from Birth to School Age. Translated by Henry 
Beaumont. New York: Farrar and Rinehart, 1935, pp. 192. 


For the past decade considerable interest has been manifest in 
devising scales for the measurement of behavioral development of 
pre-school children. Gesell is probably to be given credit for the 
earliest systematic attempt to make such an instrument. Shortly 
after the appearance of Gesell’s work a series of ‘‘ Baby-tests’”’ appeared 
from Charlotte Buehler’s laboratory at the University of Vienna. In 
the present volume these early tests have been thoroughly revised and 
extended to cover the period from one month to the sixth year of life. 
The present translation by Beaumont is from the first German edition 
of 1932. 

The test items are designed to indicate behavior in six areas: Sen- 
sory reception, bodily movement, social behavior, learning, manipula- 
tion of materials, and mental production. Obviously each of these 
could not occur at all levels, but, for example, manipulation of mate- 
rials presupposes adequate bodily movements as well as sensory 
reception; therefore, successful performance at the higher level indi- 
cates success at lower ones. There are seventeen groups of ten items 
each, one group for each of the following: Each month from one to 
eight months, for each two months from nine to twelve months, for 
each three months from thirteen to eighteen months, one for the last 
half (nineteen to twenty-four months) of the second year, and one 
group for each year from three to six. A quantitative score, the DA 
(developmental age) is secured by adding to, or subtracting from, the 
basic age (lower limit of child’s CA group). Successes in the two 
groups above the basic age are added and failures in the two groups 
below the basic age are subtracted. Each item of the series has a 
value in terms of days. The DA may be considered analogous to the 
MA and may be used to calculate a DQ. While the quantitative score 
has a value in clinical use it is also necessary to interpret the child’s 
performance qualitatively. The second half of the book constitutes 
a manual for the test. Each item is carefully described with directions 
for presenting it and with successful responses adequately illustrated. 

In the first half of the book Buehler has presented a very pene- 
trating analysis of the problem of testing pre-school children. Perhaps 
her most significant innovation is in relation to consistency of test 
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situation from one child to another. Most available tests are supposed 
to be presented in exactly the same manner to every child. Some 
authors have gone so far as to say that even the room in which the 
testing is done should be always the same. Against this practice 
Buehler presents very weighty arguments. Rather than an objective 
similarity, she feels that a functional similarity is best. Thus, she 
feels that testing of pre-school children should be done in their own 
home or, if they live in an institution, in their own room, ward, or 
cottage. Also, she feels that certain substitutions in materials for 
various test items are allowable. Wherever possible materials that 
the child is familiar with, his own playthings in fact, should be used. 
It is impossible to cite detailed examples, but her whole discussion 
makes this point of view so clear that it might well be studied by all 
psychological examiners working with very young children. 

The book has many illustrations of test materials and test situa- 
tions. There is also a very valuable bibliography of three hundred 
fifty titles including much of the work on testing pre-school children, 
especially that which has appeared in German. C. M. Louttirt. 

Indiana University. 


Noe. B. Curr. Educational Psychology. Louisville, Ky.: Standard 
Printing Company, 1936, pp. VIII + 387. 


Cuff’s Educational Psychology is an eminently teachable book 
constructed to meet the needs of a certain group of students. It 
contains the standard subject-matter of educational psychology, 
well selected, clearly organized, and simply written. Although it 
possesses little striking originality, the book is by no means an uncritical 
summary of out-of-date theories. For example, the explanations of 
learning are reviewed from the laws of association of the Greeks to the 
recent alpha, beta and gamma hypotheses of Dunlap. 

The fifteen chapters include the topics of the field of educational 
psychology; heredity and environment; growth and development; 
incentives and motives; feelings, attitudes and emotions; mental 
hygiene; intelligence; individual differences; three chapters on learning; 
transfer of training; the measurement of learning; reasoning and imagin- 
ing; and socialization and guidance. Each chapter is followed by both 
essay and objective-type exercise material. The bibliographies have 
the unusual feature of designating the ‘‘preferred references” of the 
author’s students. 
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This textbook should prove a useful tool of instruction in teachers 
colleges or wherever an elementary treatment is required. 
LAURENCE F. SHAFFER. 
Carnegie Institute of Technology. 


‘Joun E1seLe Davis and Witu1amM Rusu Dunton, Jr. Principles and 


Practice of Recreational Therapy for the Mentally Ill. New York: 
A. 8. Barnes and Company, 1936, pp. 197. 


That physical and occupational therapy can be of aid in the 
treating of the mentally ill has been recognized for a long time by many 
workers in the field. All too often in the past, however, this type of 
therapy has been done in a relatively fragmentary manner. The need 
for coérdinating such therapy with institutional programs and with 
individual psychotherapy has been much more often expressed than 
practiced. Resocializing recreational therapy in theory and practice, 
as described in this book, represents the most integrated approach to 
these problems that has come to the attention of the reviewer. In this 
volume a physician who has helped develop the concepts of the therapy 
and a physical director who has carried out the program show evidence 
of not only appreciating felt needs, but also of appreciating how to 
carry out programs that are in accord with progressive thinking in 
education and dynamic thinking in psychiatry. 

John Dewey’s Interest and Effort in Education is the chief source of 
reference for their educational thinking, and the writings of such men 
as Shepherd Franz, Adolph Meyer, White, are among the chief figures 
in psychiatry who have guided the thinking of these authors in the 
developing of their therapeutic schedules. The authors do not limit 
themselves to physical activities and the more active aspects of recrea- 
tional therapy. They also consider passive recreational forms of 
therapy. The general purpose is expressed by them in the following 
sentence: “‘This active concept goes further than the dynamic view- 
point in that the patient is viewed not only as a modifiable social 
entity, but is stimulated into active and progressive social relationships 
and evaluated from the composite picture of active and progressive 
participation as well as the levels of inactivity which go to make up 
the total configuration.” Recreational therapy is thus used by them 
as an aid in conditioning the patient to be in a state of readiness for 
effective psychotherapy, and in cases of senility is aimed at the post- 
ponement of deterioration. 
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Some of the more important subjects considered in this book are: 
Types and disease entities, education and reéducation, tests used, 
and exercises. Some of the more detailed topics included are: Play 
as an educative technique, possible transfer values of recreation, con- 
valescent therapy for the mentally ill, classification of games as to 
complexity, classification of activities as to form, tests of mental 
deterioration, and the therapeutic values of work. An over-critical 
person might find fault with the simplified treatment of the introvert 
and extrovert and the specific forms of recreational therapy given for 
each one. Kretschmer’s name is for some reason consistently mis- 
spelled. It is spelled Kritchmere. All in all, however, this is far and 
away the most informed and well-presented outline of the thinking and 
scheduling that goes to make up a comprehensive and adequate pro- 
gram of recreational therapy for the mentally ill. The chief value of 
the book is for workers in the field of physical and recreational therapy 
who work with the mentally ill. It has interest also for psychologists, 
psychiatrists, and social workers who are concerned with similar 
problems. H. MELrzer. 

Psychological Service Center, St. Louis. 


CarTER V. Goon, A. 8. Barr and Dovetas E. Scates. The Method- 
ology of Educational Research. New York: D. Appleton-Century 
Company, 1936, pp. XXI + 882. 


About ten years ago the head of a large School of Education was 
approached by a member of his staff with the suggestion that a course 
be offered in the methodology of educational research. ‘“‘ But,” 
queried the head, ‘“‘what is there to put into such a course?” Ina 
book of well over eight hundred pages the authors of The Methodology of 
Educational Research present an impressive answer. 

A brief enumeration of the principal material included reveals the 
extent and helpfulness of the contribution which this book makes: 

1. A very clear analysis of the nature of scientific thinking; 

2. An unusually thorough and helpful account of bibliographic aids 
in locating research and other material; 

_ 3. A concise account of educational historical method, including a 
detailed enumeration and discussion of legal sources; 

4. A lengthy account (two hundred pages) of the normative survey 
method, including, in addition to a summary of fact-finding procedures, 
a discussion of techniques involved in frequency analysis of docu- 
mentary material and in the utilization of index numbers; 
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5. A brief but sound analysis of experimental methods and of 
related statistical, case study, and causal procedures; 

6. Suggestive chapters on the preparation of the research report, 
the evaluation of educational writings and research, and the training 
and supervision of research workers; 

7. Numerous summaries of writings on needed research in the 
several fields of education. 

Although the book is an integrated treatise in itself, it also serves as 
a guide to special studies and techniques through the medium of 
numerous footnote and bibliographic references. If here and there the 
reader disagrees with a particular point made, as, for example, the 
importance assigned to documentary frequency studies, it must be 
remembered that the authors, although presenting a critical view of 
their own, have seemingly endeavored to mirror the various techniques 
actually employed in educational research. Every informed specialist 
in the field of education is cognizant of the discrepancy between many 
of the procedures commonly employed and the requirements of sound 
objective, valid, and significant thinking. The fact remains that 
regardless of the opinion that one may have concerning the quality of 
present-day research procedures, no one who has the slightest faith in 
the research approach to educational problems can afford to pass by this 
meaty and carefully prepared treatise. 

The book contains such an amazingly large and stimulating collec- 
tion of valuable material that it would seem that little remains to be 
done in the field of research methodology. However, with generous 
modesty the authors suggest that “‘the producer of research may need 
additional advanced training” in certain specialized fields. They cite 
the statistical analysis of data and the construction of measuring instru- 
ments as fields requiring such training. As if in response to this sug- 
gestion there has recently appeared The Scientific Study of Educational 
Problems, by W. S. Monroe and M. D. Engelhart, a book which empha- 
sises the statistical and measurement aspects of educational research. 
As yet unpublished is any fully adequate advanced treatment, as far as 
the reviewer can judge, of the methodological issues pertaining to 
philosophical, evaluative, and applicational aspects of educational 
problems. If the authors of The Methodology of Educational Research 
have not made a perfect score in describing a complete system of 
research methodology, nevertheless they have set a high standard for 
future writers. H. H. ABELSON. 

College of the City of New York. 
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Smitey BLANTON and MarGaret Gray Buanton. For Stutterer 
New York: D. Appelton-Century Company, 1936, pp. 186. 


Stutterers can help themselves and in very mild cases they can ¢ 
themselves without professional help. In more serious cases they e¢ 
still help themselves by taking a non-resistive and codéperative attitu 
towards the professional. In this very intelligible little book writ 
by the Blantons the concepts that they use in studying and treatir 
stuttering are explained. The concepts used are psychoanalytic 
nature. The level of presentation is simplified—perhaps, eve 
over-simplified. 

The content of almost half of the book is concerned with gener 
concepts which underly the development of any emotional disordé 
considered from a psychoanalytic point of view. The reason for tk 
inclusion of these concepts in this book, of course, is that they a 
definitely applicable in studying and treating stuttering. LIilustrativ 
of such ideas are: The réle of anxiety, wishful thinking, sublimation 
repression, rationalization, transference of emotion. Also considere¢ 
for similar reasons are growth of conscience in relation to feelings o 
guilt, and the significance and nature of family and social patterns 
The unconscious is described as a level of mind and is treated almos 
naively as a storehouse. 

The foregoing notions are described as being basic to an understand 
ing of underlying causes. Stuttering itself is treated as an emotions 
disorder, a form of psychoneurosis. By and large the treatment of it i 
psychogenetic. Emphasized in their conception of stuttering are sucl 
statements as the following: That it begins with the beginning of speech 
that it is not inevitably outgrown; that at ten and again at the end o 
adolescence it significantly either diminishes or becomes worse; tha 
it is fundamentally a symptom and not infrequently when it disappea 
it shows up again in a similar blocking in thinking. 

Small chapters on what parents and teachers as well as stuttere 
themselves can do about the problem are included. This book in n 
sense represents either a comprehensive or a critical study of the prob 
lem of stuttering and is not intended to do so. Its defined purposé 
of helping the stutterer it fulfills fairly well in spite of its over-simplifi 
cation and its naive psychoanalytic assumptions. H. MeEvrzer. 
Psychological Service Center, St. Louis. 
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